Models API

UsageGuard supports a large number of models that can be used to generate content using our Unified Inference API. You can use the Models API to list all available models and their capabilities.

We are continuing to add more models and modalities as we grow and with customers feedback, please check back often.

GET/v1/management/connections/models

List Available Models

Example shows how to list all available models.

Required headers

Name
Authorization
Type
string
Description
Bearer token for authentication

Request

GET

/v1/management/connections/models

curl -X GET https://api.usageguard.com/v1/management/connections/models \
  -H "Authorization: Bearer {token}"

[
  {
    "modelIdentifier": "openai.gpt-4o-mini:0",
    "displayName": "OpenAI GPT-4o Mini",
    "modelPointer": "gpt-4o-mini:latest",
    "modelProvider": "UnifiedInference",
    "maxTokens": 200000,
    "contextWindow": 200000,
    "isInstructionModel": false,
    "hasStreamingSupport": true,
    "hasSystemPromptSupport": true,
    "hasMessageHistorySupport": true,
    "hasStreamingToolCallingSupport": false,
    "hasToolCallingSupport": false,
    "inputModalities": "TEXT, IMAGE",
    "outputModalities": "TEXT",
    "disabled": false
  },
  {
    "modelIdentifier": "anthropic.claude-3.5-sonnet-20240620-v1:0",
    "displayName": "Anthropic Claude 3.5 Sonnet",
    "modelPointer": "claude-35-sonnet:latest",
    "modelProvider": "UnifiedInference",
    "maxTokens": 4096,
    "contextWindow": 200000,
    "isInstructionModel": false,
    "hasStreamingSupport": true,
    "hasSystemPromptSupport": true,
    "hasMessageHistorySupport": true,
    "hasStreamingToolCallingSupport": false,
    "hasToolCallingSupport": false,
    "inputModalities": "TEXT",
    "outputModalities": "TEXT",
    "disabled": false
  }
]