v1.82.0.patch5
📦 litellmView on GitHub →
✨ 4 features🐛 20 fixes🔧 6 symbols
Summary
This patch release focuses heavily on bug fixes across various integrations (Anthropic, Azure, HuggingFace) and infrastructure stability, alongside introducing a new User Info V2 Endpoint and allowing organization_id setting on key updates.
Migration Steps
- If you rely on specific error messages for authentication, review them as typos were corrected.
- If using Azure Model Router, note that cost breakdown is now available in the UI and additional_costs are sourced from hidden_params.
✨ New Features
- Introduced User Info V2 Endpoint.
- Added functionality to allow setting organization_id on Key Update.
- Implemented Azure Model Router cost breakdown in UI and retrieval of additional_costs from hidden_params.
- Added Vantage integration for FOCUS CSV export.
🐛 Bug Fixes
- Corrected typos in Auth Error Messages.
- Fixed issue where Public Model Hub was not showing config-defined models.
- Prevented OOM/Prisma connection loss from unbounded managed-object poll in proxy.
- Updated outdated test_responses_background_cost Assertions.
- Fixed forwarding of extra_headers to HuggingFace embedding API.
- Resolved fallback popup model dropdown z-index issue.
- Added _remove_scope_from_cache_control for Bedrock and Azure.
- Auto-filled reasoning_content for moonshot kimi reasoning models.
- Handled response.failed, response.incomplete, and response.cancelled states.
- Bumped tar to 7.5.11 and tornado to 6.5.5 for security.
- Fixed _supports_reasoning_effort_level for responses bridge.
- Preserved native tool format when guardrails convert tools for Anthropic Messages API.
- Fixed silent metrics race condition.
- Fixed tiktoken cache for nonroot offline scenarios.
- Normalized content_filtered finish_reason.
- Fixed Responses bridge variable mismatch and outdated CI tests.
- Fixed custom cost tracking on deployments for /v1/messages and /v1/responses.
- Fixed Langfuse failure path kwargs inconsistency.
- Fixed Responses Bridge Overwrite on Second Bridge Check.
- Addressed CI failures: mypy type error, ruff lint, and flaky router test.