Skip to main content

​
Overview

Nebius is an OpenAI-compatible provider offering comprehensive API support. Bifrost delegates to the OpenAI implementation with standard parameter filtering. Key features:
  • Full OpenAI compatibility - Chat, text completion, embeddings, and responses
  • Streaming support - Server-Sent Events with delta-based updates
  • AI Project ID - Nebius-specific project identifier support
  • Tool calling - Complete function definition and execution
  • Parameter filtering - Removes unsupported OpenAI-specific fields

​
Supported Operations

OperationNon-StreamingStreamingEndpoint
Chat Completions✅✅/v1/chat/completions
Responses API✅✅/v1/chat/completions
Text Completions✅✅/v1/completions
Embeddings✅-/v1/embeddings
List Models✅-/v1/models
Speech (TTS)❌❌-
Transcriptions (STT)❌❌-
Files❌❌-
Batch❌❌-
Unsupported Operations (❌): Speech, Transcriptions, Files, and Batch are not supported by the upstream Nebius API. These return UnsupportedOperationError.

​
1. Chat Completions

​
Request Parameters

Nebius supports all standard OpenAI chat completion parameters. For full parameter reference and behavior, see OpenAI Chat Completions.

​
Nebius-Specific Parameters

ai_project_id (Optional): Nebius allows specifying a project ID for resource organization: 
curl -X POST http://localhost:8080/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "nebius/model-name",
    "messages": [...],
    "ai_project_id": "project-123"
  }'
The ai_project_id is appended as a query parameter to the request URL.

​
Filtered Parameters

Removed for Nebius compatibility:
  • prompt_cache_key - Not supported
  • verbosity - Anthropic-specific
  • store - Not supported
  • service_tier - Not supported
Nebius supports all standard OpenAI message types, tools, responses, and streaming formats. For details on message handling, tool conversion, responses, and streaming, refer to OpenAI Chat Completions.

​
2. Responses API

Converted internally to Chat Completions: 
ResponsesRequest → ChatRequest → ChatCompletion → ResponsesResponse
Same parameter support and message handling as Chat Completions. Supports ai_project_id via extra_params.

​
3. Text Completions

Nebius supports legacy text completion format:
ParameterMapping
promptDirect pass-through
max_tokensmax_tokens
temperature, top_pDirect pass-through
stopStop sequences
frequency_penalty, presence_penaltyPenalty parameters

​
4. Embeddings

Nebius supports text embeddings:
ParameterNotes
inputText or array of texts
modelEmbedding model name
encoding_format”float” or “base64”
dimensionsCustom output dimensions (optional)
Response returns embedding vectors with usage information.

​
5. List Models

Lists available Nebius models with capabilities and context lengths.

​
Unsupported Features

FeatureReason
Speech/TTSNot offered by Nebius API
Transcription/STTNot offered by Nebius API
Batch OperationsNot offered by Nebius API
File ManagementNot offered by Nebius API

​
Caveats

Severity: Medium Behavior: Cache control directives are removed from messages Impact: Prompt caching features don’t work Code: Stripped during JSON marshaling
Severity: Low Behavior: OpenAI-specific fields filtered out Impact: prompt_cache_key, verbosity, store removed Code: filterOpenAISpecificParameters
Severity: Low Behavior: User field > 64 characters silently dropped Impact: Longer user identifiers are lost Code: SanitizeUserField enforces 64-char max