Skip to main content
POST
/
api
/
governance
/
model-configs
Create model config
curl --request POST \
  --url http://localhost:8080/api/governance/model-configs \
  --header 'Content-Type: application/json' \
  --data '
{
  "model_name": "<string>",
  "provider": "<string>",
  "budget": {
    "max_limit": 123,
    "reset_duration": "<string>"
  },
  "rate_limit": {
    "token_max_limit": 123,
    "token_reset_duration": "<string>",
    "request_max_limit": 123,
    "request_reset_duration": "<string>"
  }
}
'
{
  "message": "<string>",
  "model_config": {
    "id": "<string>",
    "model_name": "<string>",
    "provider": "<string>",
    "budget": {
      "id": "<string>",
      "max_limit": 123,
      "reset_duration": "<string>",
      "last_reset": "2023-11-07T05:31:56Z",
      "current_usage": 123,
      "config_hash": "<string>",
      "created_at": "2023-11-07T05:31:56Z",
      "updated_at": "2023-11-07T05:31:56Z"
    },
    "rate_limit": {
      "id": "<string>",
      "token_max_limit": 123,
      "token_reset_duration": "<string>",
      "token_current_usage": 123,
      "token_last_reset": "2023-11-07T05:31:56Z",
      "request_max_limit": 123,
      "request_reset_duration": "<string>",
      "request_current_usage": 123,
      "request_last_reset": "2023-11-07T05:31:56Z",
      "config_hash": "<string>",
      "created_at": "2023-11-07T05:31:56Z",
      "updated_at": "2023-11-07T05:31:56Z"
    },
    "created_at": "2023-11-07T05:31:56Z",
    "updated_at": "2023-11-07T05:31:56Z"
  }
}

Body

application/json

Request to create a new model config

model_name
string
required

Name of the model (required)

provider
string

Provider name (optional - applies to all providers if not specified)

budget
object

Budget configuration

rate_limit
object

Rate limit configuration

Response

Model config created successfully

Response containing a created/updated model config

message
string
model_config
object

Model configuration with budget and rate limit settings