Manage GPU Requests

View and manage the GPU provision requests (GPRs) queue in a project.

View GPRs Across the Slices

Go to GPU Requests on the left sidebar. The All GPU Requests tab shows all the GPU requests across all the slices in a project for an admin.

Use the Search textbox or Filter to filter the GPRs.

View the GPRs Specific to a Slice

On the GPU Requests page, go to the GPU Requests Per Slice tab, and click the slice to see its specific GPRs.

Create GPRs

You can create GPRs as a slice user or an admin.

To create a GPR:

1. On the GPU Requests page, go to the GPU Requests Per Slice tab.

2. In the slice list, click the slice for which you want to create a GPR.

3. Click Create GPU Request.

   

4. On the Create GPU Request page, add the request details:

   1. For Cluster Selection, from the Cluster drop-down list, select a cluster for which you want to request GPU nodes.

   2. For GPU Configuration:

      1. Enter a name in the Request Name text box.
      2. Select Node Type from its drop-down list. The GPU Shape and Memory per GPU are auto populated.
      3. Set the GPU Per Node if you want to change its default value, 1.
      4. Set the GPU Nodes if you want to change its default value, 1.

   3. For Priority Configuration:

      1. User is auto populated.

      2. Set Priority. The default value is Medium (101-200).

         You can change the priority of a GPR in the queue. You can change the priority number (low: 1-100, medium: 101-200, high: 201-300) to move a GPR in the queue. When a GPR is moved to the top of the queue, it is provisioned when the resources are available to provision the GPR.

      3. Set Priority Number. The default value is 101

      4. Specify Reserve for duration in Days, Hrs, and Mns.

      5. (Optional) Set the idle time out to allow the GPU nodes to be used after the configured length of the time that it can be idle. This allows other GPRs to use the unused provisioned GPU nodes.

      6. (Optional) To make the idle timeout to be effective, the Enforce Idle Timeout is auto selected. If you want to only configure the timeout without enforcing, then unselect this checkbox.

      7. Click the Get Wait Time button.

      8. Clicking Get Wait Time automatically switches to the Request GPU tab.

         

         EGS shows the estimated wait time for the GPU nodes provisioning.

   4. Select the GPU in the Available GPUs table with acceptable estimated wait time.

   5. Click Request GPUs.

5. View the GPR in the User's GPU Requests queue.

6. Click GPR to view request details.

   

Manage GPR Queues

The GPR Queue helps to visualize and control how GPU requests created under various slices would be processed. As an admin, one can track queues for each cluster and node instances and change the execution order by adjusting priority.

Change GPR Priority

Expand the GPU Requests on the left side bar to see the Priority Queue. The Priority Queue page shows the priority of the GPRs.

You can change the priority of a GPR in the queue. You can select a GPR and increase the priority number (low: 1-100, medium: 101-200, high: 201-300) to move a GPR higher in the queue. When a GPR is moved to the top of the queue, it is provisioned when the resources are available to provision the GPR.

Edit a GPR

1. For a queued GPR, under Actions, expand the vertical ellipsis menu, and click Edit.

   

2. After editing the values, click Update.

Early Release a Provisioned GPR

You can early release a provisioned GPR. The early release of a GPR removes the associated GPU nodes from the slice.

You can use this workflow to free up GPUs to provision a higher priority GPR. You can use this workflow for any other admin operations or under utilization of GPU resources, user requests, and so on.

To early release a provisioned GPR:

1. On the GPU Requests page, under Actions, expand the vertical ellipsis, and click Early Release from the menu.

2. On the confirmation dialog, enter RELEASE and click Release GPR.

   

GPR Eviction

You can early release provisioned GPRs and make required nodes available for the high priority top GPR to be provisioned.

You can see a list of GPRs that needs to be evicted to provision the top GPR. You can manually early-release the GPRs to make room for the top GPR.

Delete a GPR

You as an admin can delete a GPR that is queued.

1. Go to the GPU Requests on the left sidebar.

   

2. Identify the GPR which is Queued.

3. Under Action column of that GPR, click x mark to delete it or choose Delete from the Actions menu by pulling up the vertical ellipsis.

4. On the confirmation dialog, enter DELETE and press Delete GPR.