- NPX
- Docker
✨ Features
- pprof Profiling Server - Optional runtime profiling server gated by
BIFROST_PPROF_PORT, with env-tunable block/mutex sampling rates and graceful shutdown alongside the main server. - Anthropic Cache Diagnostics - Surface Anthropic’s prompt-cache diagnostics beta (
cache-diagnosis-2026-04-07): responses now expose the first cache-prefix divergence point, so you can see exactly why a prompt cache missed.
🐞 Fixed
- GenAI Raw Request Passthrough - Native Vertex/Gemini batch and request bodies now follow the
x-model-providerheader and pass through verbatim only when Gemini or Vertex is explicitly selected, preventing a raw body from reaching a mismatched provider. - Tool Call Metadata Preservation -
extra_contenton assistant tool calls (e.g. Geminithought_signature) is now preserved across both streaming and non-streaming responses (thanks @nghodkicisco!).
- fix: preserve extra_content on ChatAssistantMessageToolCall so provider-specific tool-call metadata (e.g. Gemini thought_signature) round-trips losslessly through the gateway (thanks @nghodkicisco!)
- fix: surface Anthropic prompt-cache diagnostics (cache-diagnosis-2026-04-07 beta) via new CacheDiagnostics/CacheMissReason schema, reporting the first cache-prefix divergence point on chat and responses APIs
- fix: carry tool-call extra_content through the streaming accumulator - deep-copied per chunk and accumulated across deltas (thanks @nghodkicisco!)
- chore: upgraded core to v1.5.21
- chore: upgraded core to v1.5.21 and framework to v1.3.21
- chore: upgraded core to v1.5.21 and framework to v1.3.21
- chore: upgraded core to v1.5.21 and framework to v1.3.21
- chore: upgraded core to v1.5.21 and framework to v1.3.21
- chore: upgraded core to v1.5.21 and framework to v1.3.21
- chore: upgraded core to v1.5.21 and framework to v1.3.21
- chore: upgraded core to v1.5.21 and framework to v1.3.21
- chore: upgraded core to v1.5.21 and framework to v1.3.21
- chore: upgraded core to v1.5.21 and framework to v1.3.21
- chore: upgraded core to v1.5.21 and framework to v1.3.21
- chore: upgraded core to v1.5.21 and framework to v1.3.21

