Change8

v1.95.0-rc.1

📦 litellmView on GitHub →
9 features🐛 25 fixes🔧 51 symbols

Summary

This release introduces Docker image signature verification using cosign and includes numerous UI enhancements and bug fixes across various modules like guardrails, proxy, and logging. Key features include SAML 2.0 SSO for the admin UI and support for Claude Opus 5.

Migration Steps

  1. Replace deprecated `gpt-5-codex` with `gpt-5.3-codex`.

✨ New Features

  • Verify LiteLLM Docker images using cosign with provided commands.
  • Show in the log drawer and session sidebar when an auto-router served a request.
  • Standalone /connect route for MCP OAuth, decoupled from Chat UI flag.
  • Add Claude Opus 5 model.
  • Add SAML 2.0 SSO for the admin UI.
  • Add run_in_parallel opt-in for concurrent pre_call and post_call guardrails.
  • Migrate the Create Organization form to shadcn and react-hook-form.
  • Deep-link virtual key detail view via ?key= query param.
  • Record cost and usage reported by the upstream target in passthrough mode.

🐛 Bug Fixes

  • Keep cache leakage time range picker inline at narrow widths.
  • Handle None metadata in post_call _process_response for guardrails/model_armor.
  • Stop scheduling sync failure_handler concurrently with async_failure_handler.
  • Incrementally parse accumulated Gemini stream JSON to prevent multi-value wedge for Vertex AI.
  • Install bedrock-realtime extra for Nova Sonic realtime in gateway.
  • Handle explicit outputInfo: null in Vertex AI batch response.
  • Keep an MCP tool call in one trace, anchored to its own request for OpenTelemetry.
  • Keep a key's MCP toolsets when saving an edit.
  • Bind key duration input to one Form.Item so pre-filled expiry submits.
  • Derive the dashboard object_permission type from the generated schema.
  • Keep entity usage tabs aligned with their panels.
  • Stop reporting a no-op guardrail as applied on passthrough.
  • Return 400 instead of 500 for chat completions without messages.
  • Keep guardrail information in spend logs when the caller sends its own metadata.
  • Strip include_usage from stream_options instead of dropping the param.
  • Add /v1/messages support for Straiker plugin in guardrails.
  • Resolve managed unified input_file_id to storage_url with ownership check before dispatch for proxy/batches.
  • Derive tokens_saved when Headroom compression service omits it for guardrails.
  • Attribute org spend for team-linked credentials minted without org_id for proxy.
  • Make managed-file resolution additive, restore fall-back for missing-row and lookup errors for proxy/batches.
  • Backfill usage on non-streaming /v1/messages responses for bedrock-mantle.
  • Cap /v1/tool/spend window at 30 days and bound every SpendLogs read for proxy.
  • Scope and bound the End User filter on the logs page.
  • Merge model-level guardrails before pre_call_hook.
  • Don't cool down parent deployment on advisor sub-call failure for router.

Affected Symbols