●Change8

v1.94.0-dev.1

📦 litellmView on GitHub →
✨ 12 features🐛 22 fixes🔧 13 symbols

Summary

This release introduces enhanced Docker image signature verification using cosign and includes numerous improvements to the UI, router, and proxy functionalities. Key updates involve new routing plugins, adaptive modes, and better handling of batch costs and authentication.

Migration Steps

  1. Verify Docker image signatures using cosign. Recommended method is to use the pinned commit hash for stronger security.
  2. Update the `pillow` dependency to `12.3.0` to resolve CVEs.

✨ New Features

  • Working Test Connection for the complexity auto router in the UI.
  • Adopt openapi-react-query and convert useCustomers in the UI.
  • Random-pick multi-model complexity tiers for the router.
  • Add Router(plugins=[...]) routing-plugin pipeline.
  • Soft-floor adaptive mode for the complexity router.
  • Track cost for unmanaged Bedrock batches and generalize the flag.
  • Mint gateway-bound envelope at the token endpoint for dcr_bridge oauth_delegate.
  • Send source.type for Used By attribution.
  • Rebuild the Virtual Keys table on the shared DataTable.
  • Interactive SSO sign-in for dcr_bridge oauth_delegate DCR clients.
  • Client-held refresh envelope for the dcr_bridge oauth_delegate flow.
  • Rebuild the Teams table on the shared DataTable.

🐛 Bug Fixes

  • Use StandardLoggingGuardrailInformation in logging hook for xecguard.
  • Stop unrecognized model namespaces slipping through provider wildcard keys for proxy-auth.
  • Sanitize scan result before recording it for logging in xecguard.
  • Filter embedding models in complexity tab dropdowns, require all tiers, inline validation for auto_router.
  • Translate raw adaptive thinking for pre-4.6 models on chat completions and Bedrock Converse for anthropic.
  • Add supports_reasoning: false to Gemini image generation models for model_cost.
  • Walk custom_tool_call_output items in _content_utils for guardrails.
  • Show and allow editing team model aliases after team creation.
  • Bump pillow to 12.3.0 to resolve osv-scan CVEs.
  • Surface rejected delegate-auth upstream tokens as connect-time 401 for mcp.
  • Track unauthenticated pass-through requests in spend logs.
  • Continue MCP gateway tool turns from the final response and surface failures.
  • Forward aws credential kwargs into litellm_params so the responses bridge keeps WIF auth.
  • Respect litellm_key_header_name in BYOK credential save and workflow runs fetches for UI.
  • Redact async complete streaming response for custom callbacks.
  • Clamp max_output_tokens below API minimum for openai/responses.
  • Read v3 rate limiter remaining values for per-key model gauges for prometheus.
  • Drop w-full from page-content wrappers to remove 32px horizontal overflow for UI.
  • Correct Responses API tool_choice shape and propagate alias litellm_params for auto-router.
  • Render the sidebar scrollbar with shadcn ScrollArea for UI.
  • Relay upstream OAuth token and DCR rejections instead of a generic 500 for mcp.
  • Persist key_type so the UI shows correct key scope instead of "All Proxy Models".

Affected Symbols

cosignlitellmxecguardproxy-authauto_routeranthropicroutermodel_costguardrailsmcpopenaiprometheusui