Skip to main content
Guardrails are an enterprise-only feature and require the enterprise Bifrost image.
Guardrails are configured under guardrails_config in config.json. The configuration has two parts:
  • guardrail_providers — the backend that performs the check. Rules link to providers by id.
  • guardrail_rules — CEL expressions that control when and where providers are invoked.

Providers

Runs entirely in-process with no external dependency. Patterns use RE2 syntax. Supports optional per-pattern flags: i (case-insensitive), m (multiline), s (dot-all).
{
  "guardrails_config": {
    "guardrail_providers": [
      {
        "id": 1,
        "provider_name": "regex",
        "policy_name": "block-secrets",
        "enabled": true,
        "timeout": 5,
        "config": {
          "patterns": [
            { "pattern": "sk-[A-Za-z0-9]{20,}", "description": "OpenAI API key" },
            { "pattern": "AKIA[0-9A-Z]{16}", "description": "AWS access key" },
            { "pattern": "gh[ps]_[A-Za-z0-9]{36}", "description": "GitHub token", "flags": "i" }
          ],
          "mode": "block"
        }
      }
    ]
  }
}

Provider Fields

FieldRequiredDescription
idYesUnique integer ID — referenced by rules via provider_config_ids
provider_nameYesBackend: "regex", "bedrock", "azure", "grayswan"
policy_nameYesHuman-readable policy label
enabledYestrue to activate
timeoutNoExecution timeout in seconds
configNoProvider-specific configuration object

Rules

Rules are CEL expressions that fire when their condition matches. Available CEL variables:
VariableTypeDescription
modelstringModel name from the request
providerstringProvider name (e.g. "openai")
headersmap<string,string>HTTP request headers
paramsmap<string,string>Query parameters
customerstringCustomer ID
teamstringTeam ID
userstringUser ID
{
  "guardrails_config": {
    "guardrail_rules": [
      {
        "id": 101,
        "name": "block-secrets-input",
        "description": "Block prompts containing credentials",
        "enabled": true,
        "cel_expression": "true",
        "apply_to": "input",
        "sampling_rate": 100,
        "timeout": 10,
        "provider_config_ids": [1]
      },
      {
        "id": 102,
        "name": "content-safety-gpt4o-output",
        "enabled": true,
        "cel_expression": "model == 'gpt-4o'",
        "apply_to": "output",
        "sampling_rate": 100,
        "timeout": 15,
        "provider_config_ids": [3]
      },
      {
        "id": 103,
        "name": "grayswan-openai-partial",
        "enabled": true,
        "cel_expression": "provider == 'openai'",
        "apply_to": "input",
        "sampling_rate": 50,
        "timeout": 20,
        "provider_config_ids": [4]
      }
    ]
  }
}

Rule Fields

FieldRequiredDescription
idYesUnique integer ID
nameYesHuman-readable name
descriptionNoOptional description
enabledYestrue to activate
cel_expressionYesCEL boolean expression. "true" matches every request
apply_toYes"input", "output", or "both"
sampling_rateNo0100; percentage of requests to evaluate (default: 100)
timeoutNoRule timeout in seconds
provider_config_idsNoid values of providers to invoke when this rule matches. Multiple providers run in parallel

Full Example

{
  "$schema": "https://www.getbifrost.ai/schema",
  "encryption_key": "env.BIFROST_ENCRYPTION_KEY",

  "providers": {
    "openai": {
      "keys": [{ "name": "primary", "value": "env.OPENAI_API_KEY", "models": ["*"], "weight": 1.0 }]
    }
  },

  "guardrails_config": {
    "guardrail_providers": [
      {
        "id": 1,
        "provider_name": "regex",
        "policy_name": "block-secrets",
        "enabled": true,
        "timeout": 5,
        "config": {
          "patterns": [
            { "pattern": "sk-[A-Za-z0-9]{20,}", "description": "OpenAI API key" },
            { "pattern": "AKIA[0-9A-Z]{16}", "description": "AWS access key" }
          ],
          "mode": "block"
        }
      },
      {
        "id": 2,
        "provider_name": "azure",
        "policy_name": "content-safety",
        "enabled": true,
        "timeout": 10,
        "config": {
          "endpoint": "https://your-resource.cognitiveservices.azure.com",
          "api_key": "env.AZURE_CONTENT_SAFETY_KEY",
          "analyze_enabled": true,
          "analyze_severity_threshold": "medium",
          "jailbreak_shield_enabled": true,
          "indirect_attack_shield_enabled": false
        }
      }
    ],
    "guardrail_rules": [
      {
        "id": 101,
        "name": "block-secrets-input",
        "description": "Block prompts leaking credentials",
        "enabled": true,
        "cel_expression": "true",
        "apply_to": "input",
        "sampling_rate": 100,
        "timeout": 10,
        "provider_config_ids": [1]
      },
      {
        "id": 102,
        "name": "content-safety-both",
        "description": "Azure content safety on all traffic",
        "enabled": true,
        "cel_expression": "true",
        "apply_to": "both",
        "sampling_rate": 100,
        "timeout": 15,
        "provider_config_ids": [2]
      }
    ]
  }
}