​

Overview

• Parameter renaming - e.g., max_completion_tokens → max_tokens, top_p → p, stop → stop_sequences
• Message content conversion - String and content block formats handled
• Tool conversion - Tool definitions and tool choice mapped to Cohere format
• Thinking/Reasoning transformation - reasoning parameters mapped to Cohere’s thinking structure
• Response format conversion - JSON schema handling adapted to Cohere’s format

​

Supported Operations

​

1. Chat Completions

​

Request Parameters

​

Parameter Mapping

​

Dropped Parameters

​

Extra Parameters

curl -X POST http://localhost:8080/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "cohere/command-r-plus",
    "messages": [{"role": "user", "content": "Hello"}],
    "top_k": 40,
    "safety_mode": "STRICT",
    "log_probs": true,
    "strict_tool_choice": false
  }'

resp, err := client.ChatCompletionRequest(ctx, &schemas.BifrostChatRequest{
    Provider: schemas.Cohere,
    Model:    "cohere/command-r-plus",
    Input:    messages,
    Params: &schemas.ChatParameters{
        ExtraParams: map[string]interface{}{
            "top_k": 40,
            "safety_mode": "STRICT",
            "log_probs": true,
            "strict_tool_choice": false,
        },
    },
})

​

Reasoning / Thinking

​

Parameter Mapping

• reasoning.effort → thinking.type (mapped to "enabled" or "disabled")
• reasoning.max_tokens → thinking.token_budget (token budget for thinking)

​

Critical Constraints

• Minimum budget: 1 token required; requests with 0 tokens will be converted to disabled
• Dynamic budget: -1 is converted to 1 automatically

​

Example

// Request
{"reasoning": {"effort": "high", "max_tokens": 2048}}

// Cohere conversion
{"thinking": {"type": "enabled", "token_budget": 2048}}

​

Message Conversion

​

Content Handling

• String content: Messages can have simple string content
• Content blocks: Messages can have arrays of content blocks (text, images, thinking)
• Image conversion: image_url blocks with URL are supported
• Tool calls: Converted from message assistant tool calls to Cohere format
• Tool messages: Tool call results are passed with tool_call_id

​

Tool Conversion

• Function name → name (unchanged)
• Function parameters → parameters (flexible JSON format)
• Strict mode (strict: true) is silently dropped (not supported)

• "none" → "NONE"
• "auto" or "required" → "REQUIRED" or "AUTO"
• Specific tool selection → "REQUIRED" (Cohere uses function-level selection)

​

Response Format

• text - Plain text response
• json_object - Structured JSON response
• json_schema - JSON with schema validation (converted to json_object)

​

Response Conversion

​

Field Mapping

• finish_reason: COMPLETE / STOP_SEQUENCE → stop, MAX_TOKENS → length, TOOL_CALL → tool_calls
• input_tokens → prompt_tokens | output_tokens → completion_tokens
• cached_tokens → prompt_tokens_details.cached_tokens (if present)
• Tool call arguments converted from string → string (no conversion needed, Cohere uses string format)

​

Streaming

• content-delta with text → message content
• content-delta with thinking → reasoning text
• tool-call-start/delta/end → tool call events
• tool-plan-delta → tool planning output

​

Caveats

​

2. Responses API

​

Request Parameters

​

Parameter Mapping

​

Extra Parameters

curl -X POST http://localhost:8080/v1/responses \
  -H "Content-Type: application/json" \
  -d '{
    "model": "cohere/command-r-plus",
    "input": "Hello, how are you?",
    "top_k": 40,
    "stop": [".", "!"]
  }'

resp, err := client.ResponsesRequest(ctx, &schemas.BifrostResponsesRequest{
    Provider: schemas.Cohere,
    Model:    "cohere/command-r-plus",
    Input:    messages,
    Params: &schemas.ResponsesParameters{
        ExtraParams: map[string]interface{}{
            "top_k": 40,
            "stop": []string{".", "!"},
        },
    },
})

​

Input & Instructions

• Input: String converted to user message or array converted to messages
• Instructions: Becomes system message (prepended to messages)

​

Tool Support

​

Response Conversion

• text → message | tool_use → function_call
• input_tokens / output_tokens preserved
• Token details with cached tokens support

​

Streaming

• Tool call arguments accumulated across chunks
• Synthetic output_item.added events emitted for text/reasoning
• Stable item IDs generated as msg_{messageID}_item_{outputIndex}

​

3. Embeddings

​

Request Parameters

​

Parameter Mapping

​

Extra Parameters

curl -X POST http://localhost:8080/v1/embeddings \
  -H "Content-Type: application/json" \
  -d '{
    "model": "cohere/embed-english-v3.0",
    "input": ["text to embed"],
    "input_type": "search_query",
    "embedding_types": ["float"],
    "truncate": "START"
  }'

resp, err := client.EmbeddingRequest(ctx, &schemas.BifrostEmbeddingRequest{
    Provider: schemas.Cohere,
    Model:    "cohere/embed-english-v3.0",
    Input: &schemas.EmbeddingInput{
        Texts: []string{"text to embed"},
    },
    Params: &schemas.EmbeddingParameters{
        Dimensions: schemas.Ptr(1024),
        ExtraParams: map[string]interface{}{
            "input_type": "search_query",
            "embedding_types": []string{"float"},
            "truncate": "START",
        },
    },
})

​

Critical Notes

• Input Type Required: Cohere v3+ models require input_type parameter (defaults to "search_document")
• Embedding Types: Specify which embedding types to return (e.g., "float", "int8")

​

Response Conversion

• embeddings.float → data[].embedding
• meta.tokens → usage information
• Multiple embedding types handled

​

4. List Models