Skip to main content

Manage Endpoints

View All Endpoints

In the left sidebar, under Dedicated Inference, click My endpoints.

My endpoints tab with stats cards and endpoints table

Page title: My dedicated models Manage endpoints, monitor deployment status and GPU costs.

The summary cards at the top show workspace totals:

CardWhat it shows
ENDPOINTSTotal number of endpoints
RUNNINGActive endpoints right now
GPU-HOURSGPU-hours consumed this month
SPENDCost this month

Click Refresh to reload the latest status. The table timestamp (Updated: DD/MM/YYYY HH:MM) shows when data was last fetched.

Deployed Endpoints Table

ColumnDescription
ENDPOINTEndpoint name and model
HARDWAREGPU configuration
STATUSRunning · Deploying · Stopped
REPLICASActive / total replicas
GPU-HGPU-hours consumed
COST (MTD)Cost billed month-to-date
ACTIONSPause (Running) · Resume (Stopped) · View (Deploying)

Endpoint Statuses

StatusMeaning
DeployingGPU is being provisioned and model weights are being downloaded
RunningAll replicas are ready and serving requests
StoppedScaled to zero — no GPU active

Pause an Endpoint

  1. Find the endpoint in the table.
  2. Click Pause in the Actions column.
  3. Confirm the action.

To restart, click Resume in the Actions column.

Delete an Endpoint

  1. Click the endpoint name to open the detail page.
  2. Use the delete action in the endpoint settings.
danger

Deleting an endpoint is irreversible. You will need to redeploy from scratch.

Deploy a New Endpoint

Click Deploy new (top right) to open the Deploy Dedicated Endpoint modal.

See detailed guide: Deploy a Model