Skip to main content

dedicated_inference_gpu_model_config

Creates, updates, deletes, gets or lists a dedicated_inference_gpu_model_config resource.

Overview​

Namededicated_inference_gpu_model_config
TypeResource
Iddigitalocean.inference.dedicated_inference_gpu_model_config

Fields​

The following fields are returned by SELECT queries:

GPU model configs (gpu_slugs, model_slug, model_name, is_gated_model).

NameDatatypeDescription
model_namestring (example: Mistral-7B-Instruct-v0.3)
gpu_slugsarray
is_gated_modelbooleanWhether the model requires gated access (e.g. Hugging Face token).
model_slugstring (example: mistral/mistral-7b-instruct-v3)

Methods​

The following methods are available for this resource:

NameAccessible byRequired ParamsOptional ParamsDescription
dedicated_inferences_get_gpu_model_configselectGet supported GPU and model configurations for Dedicated Inference. Use this to
discover supported GPU slugs and model slugs (e.g. Hugging Face). Send a GET
request to /v2/dedicated-inferences/gpu-model-config.

Parameters​

Parameters can be passed in the WHERE clause of a query. Check the Methods section to see which parameters are required or optional for each operation.

NameDatatypeDescription

SELECT examples​

Get supported GPU and model configurations for Dedicated Inference. Use this to
discover supported GPU slugs and model slugs (e.g. Hugging Face). Send a GET
request to /v2/dedicated-inferences/gpu-model-config.

SELECT
model_name,
gpu_slugs,
is_gated_model,
model_slug
FROM digitalocean.inference.dedicated_inference_gpu_model_config
;