●Change8

v1.92.0-dev.2

📦 litellmView on GitHub →
✨ 15 features🐛 20 fixes🔧 14 symbols

Summary

This release introduces Docker image signature verification via cosign and brings numerous fixes and feature enhancements across the proxy, UI, and various model providers like Bedrock, Vertex AI, and MCP.

Migration Steps

  1. If you rely on the UI to update API keys, note that the Update API Key modal now only rotates the api_key and a normal save cannot overwrite secrets.
  2. If using Bedrock with Opus 4.7/4.8, be aware that toolSpec.strict is dropped.
  3. If using Bedrock with Claude Sonnet 4, be aware that strict/additionalProperties are dropped from toolSpec.

✨ New Features

  • Added support for verifying LiteLLM Docker image signatures using cosign.
  • Added audit of default user settings updates in the proxy.
  • Added support for object_permission in default_key_generate_params for the proxy.
  • Added CCR (compress-cache-retrieve) via agentic loop for guardrails/headroom.
  • Added cache control injection support for v1/messages endpoint.
  • Added audit of remaining system-wide settings updates in the proxy.
  • Added mcp_tool_search virtual tools for large tool catalogs.
  • Disclaimed that the Update API Key modal only rotates api_key in the UI.
  • Added xai.grok-4.3 to model cost map for SigV4 auth in Bedrock Mantle.
  • Routed /v1/messages to Copilot native Anthropic endpoint for GitHub Copilot.
  • Implemented Google Distributed Cloud (GDC) Gemini provider.
  • Passed full imageConfig dict for Gemini image generation in Vertex AI.
  • Exposed MCP tool metadata in Prometheus metrics.
  • Tracked cost for unmanaged Vertex AI batch jobs.
  • Bound outbound tool-call concurrency per MCP server.

🐛 Bug Fixes

  • Extended banned-params + admin-clear lists in the proxy.
  • Fixed Router Settings Loadbalancing tab save in the UI.
  • Rotated model credentials in a dedicated modal in the UI so a normal save can't overwrite secrets.
  • Fixed websearch_interception agentic loop for chat completions and anthropic messages.
  • Exposed project_alias in custom metadata labels for Prometheus.
  • Hydrated MCP server registry from DB on startup when store_model_in_db is false.
  • Authorized /health/test_connection against loaded deployment's team_id in the proxy.
  • Admin-gated permissions on /key/update and /key/regenerate in the proxy.
  • Tightened role gating on /get/config/callbacks response in the proxy.
  • Dropped toolSpec.strict for Opus 4.7/4.8 in Bedrock converse.
  • Triggered Nova Sonic generation on response.create in Bedrock so realtime sessions stop hanging.
  • Dropped strict/additionalProperties from toolSpec for Claude Sonnet 4 in Bedrock.
  • Rolled up MCP tool spend to user counters and usage UI.
  • Resolved model_map_value for proxy custom pricing in logging.
  • Tightened role-based visibility on /v1/mcp/server/submissions.
  • Gated OAuth authorize/token/register/discovery on auth_type=oauth2 in MCP.
  • Restored admin key/team callback_vars.turn_off_message_logging override in the proxy.
  • Merged metadata.tags into litellm_metadata on /v1/responses route.
  • Applied claude-sonnet-5 introductory pricing through 2026-08-31 in model prices.
  • Resolved worktree root before relative_to in type_check_gate.

Affected Symbols

ghcr.io/berriai/litellm:v1.92.0-dev.2/v1/messages/health/test_connection/key/update/key/regenerate/get/config/callbackstoolSpec.stricttoolSpecimageConfig/v1/mcp/server/submissionsauth_type=oauth2callback_vars.turn_off_message_loggingmetadata.tags/v1/responses