Skip to main content

dedicated_inference_gpu_model_config

Creates, updates, deletes, gets or lists a dedicated_inference_gpu_model_config resource.

Overview

Namededicated_inference_gpu_model_config
TypeResource
Iddigitalocean.inference.dedicated_inference_gpu_model_config

Fields

The following fields are returned by SELECT queries:

GPU model configs (gpu_slugs, model_slug, model_name, is_gated_model).

NameDatatypeDescription
model_namestring (example: Mistral-7B-Instruct-v0.3)
gpu_slugsarray
is_gated_modelbooleanWhether the model requires gated access (e.g. Hugging Face token).
model_slugstring (example: mistral/mistral-7b-instruct-v3)

Methods

The following methods are available for this resource:

NameAccessible byRequired ParamsOptional ParamsDescription
dedicated_inferences_get_gpu_model_configselectGet supported GPU and model configurations for Dedicated Inference. Use this to
discover supported GPU slugs and model slugs (e.g. Hugging Face). Send a GET
request to /v2/dedicated-inferences/gpu-model-config.

Parameters

Parameters can be passed in the WHERE clause of a query. Check the Methods section to see which parameters are required or optional for each operation.

NameDatatypeDescription

SELECT examples

Get supported GPU and model configurations for Dedicated Inference. Use this to
discover supported GPU slugs and model slugs (e.g. Hugging Face). Send a GET
request to /v2/dedicated-inferences/gpu-model-config.

SELECT
model_name,
gpu_slugs,
is_gated_model,
model_slug
FROM digitalocean.inference.dedicated_inference_gpu_model_config
;