v1.97.0-rc.1
📦 litellmView on GitHub →
✨ 4 features🐛 23 fixes🔧 14 symbols
Summary
This release focuses on numerous bug fixes across various integrations like Azure Sentinel, Bedrock, and the proxy. It also introduces new features for the auto-router and UI, alongside enhanced Docker image signature verification.
Migration Steps
- When verifying Docker image signatures, use the pinned commit hash for the strongest security guarantee: `cosign verify --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub ghcr.io/berriai/litellm:v1.97.0-rc.1`
- Alternatively, use the release tag for convenience: `cosign verify --key https://raw.githubusercontent.com/BerriAI/litellm/v1.97.0-rc.1/cosign.pub ghcr.io/berriai/litellm:v1.97.0-rc.1`
✨ New Features
- Added an opt-in feature to apply user budgets to team keys.
- The UI now shows user email or alias in usage data export.
- The auto-router now tracks turns per complexity tier.
- Guardrails can now chunk oversized Bedrock ApplyGuardrail requests instead of failing.
🐛 Bug Fixes
- Azure Sentinel: Respect AZURE_AUTHORITY_HOST and derive the Azure Monitor audience per cloud.
- Bedrock: Pass SSE-KMS key through to the batch input-file S3 upload.
- Anthropic adapter: Stop indexing choices[0] on choiceless streaming chunks.
- Bedrock: Normalize /v1/completions and /v1/responses batch records.
- Proxy: Return the real status code when a credential update is rejected.
- Proxy: Improve Headroom /v1/compress HTTP 404 diagnostics.
- Proxy: Invalidate cached project object on project update and delete.
- Proxy: Stop alerting on health probes that lose the planned engine-restart race.
- Docker: Gate the componentized gateway and backend images on an arbitrary-uid offline boot.
- HTTP: Stop pooled clients persisting cookies on the aiohttp jar.
- Router: Bound fallback-walk work and error-log volume.
- Azure Sentinel: Add AZURE_SENTINEL_AUTHORITY_HOST as a Sentinel scoped override.
- Proxy: Derive config agent ids from agent_name so grants survive secret rotation.
- Proxy: Deny agent access when key and team grants resolve to nothing.
- A2A: Align agent list annotation and test with the tuple return type.
- Websearch: Restore snippet text in native web_search_tool_result blocks.
- Proxy: Resolve entity access groups in the model listing endpoints.
- UI: Let access groups be a team's only model source, with hover provenance.
- Managed files: Return unified output file ids from GET /batches.
- OTEL: Name the RPC system and upstream on MCP tool-call spans.
- Responses: Forward allowed_openai_params through the chat completions bridge.
- Vertex AI: Surface real error/status on vertex batch create instead of IndexError 500.
- Proxy: Enforce require_managed_files on every route that accepts a raw provider id.