Documentation Index
Fetch the complete documentation index at: https://docs.getbifrost.ai/llms.txt
Use this file to discover all available pages before exploring further.
Changelog
This release introduces realtime (WebSocket/WebRTC) support, Fireworks AI as a new provider, a comprehensive SCIM provider expansion (Google Workspace, Keycloak, Zitadel, SailPoint), access profiles for fine-grained permission control, business units and teams for organizational hierarchy, a user ranking dashboard, and a guardrail verification flow.✨ Features
- Realtime Support - WebSocket, WebRTC, and client secret handlers with session state management and transport context helpers for real-time streaming use cases
- Fireworks AI Provider - Fireworks AI added as a first-class provider with native completions, responses, embeddings, and image generations
- Access Profiles - Fine-grained permission control with access profiles for managing model access at team and business unit levels, including propagation dialogs and full CRUD UI
- SCIM Provider Expansion - Added support for Google Workspace, Keycloak, Zitadel, and SailPoint identity providers with full SCIM provisioning, attribute mapping, and sync workflows
- Okta Custom Provider + Group Mapping - Custom Okta provider configurations with attribute-to-role, team, and business unit mapping support
- Business Units & Teams - New organizational hierarchy for managing users with business units, teams, sync dialogs, and detail sheets
- User Ranking Dashboard - Dashboard for tracking and visualizing user activity and rankings
- Guardrail Verify Flow - Verify guardrail configurations against providers (Azure, Bedrock, GraySwan) before deployment
- Per-User OAuth Consent - Per-user OAuth consent flow with identity selection and MCP authentication
- Prompts Plugin - New prompts plugin with direct key header resolver and selective message inclusion when committing prompt sessions
- Bedrock Embeddings & Image Gen - Embeddings, image generation, edit, and variation support added to Bedrock provider
- Logging Tracking Fields - Support for tracking userId, teamId, customerId, and businessUnitId in logging plugin
- Virtual Keys Export - Sorting and CSV export added to virtual keys table
- Path Whitelisting - Allow path whitelisting from security config
- Model Blacklist in Load Balancing - Blacklist model support in the load balancing plugin to exclude specific models from routing
- Cluster Leader Badge - Leader badge display added to cluster node view
- Server Bootstrap Timer - Startup diagnostics with server bootstrap timer
🐞 Fixed
- Traffic Distribution Label - Added “last 10s” label to Traffic Distribution Sankey chart for clarity
- Node ID Consistency - Generate unique node ID on config load with minor consistency fixes
- Leader Election Stability - Increased leader election check interval to 10 seconds for improved stability
- Bedrock Tool Choice - Fix bedrock tool choice conversion to auto
- Bedrock Streaming Retries - Retry retryable AWS exceptions and stale/closed-connection errors in bedrock streaming
- Bedrock SigV4 Service - Correct SigV4 service name for agent runtime rerank
- MCP Tool Logs - Fix MCP tool logs not being captured correctly
- Routing Rule Targets - Preserve routing rule targets for genai and bedrock paths
- Provider Budget Duplication - Fix provider level multiline budget duplication issue
- Vertex Endpoint - Fix vertex endpoint correction
- Gemini Thinking Budget - Fix thinking budget validation for gemini models
- SQLite Migrations - Fix SQLite migration connections, error handling, and disable foreign key checks during migration
- Tool Parameter Schemas - Preserve explicit empty tool parameter schemas for openai passthrough
- List Models Output - Include raw model ID in list-models output alongside aliases
- Config Schema - Fix config schema for bedrock key config
- Data Race Fix - Fix race in data reading from fasthttp request for integrations
- Model Listing - Unify /api/models and /api/models/details listing behavior
📀 Base OSS version
transports/v1.5.0-prerelease2