v1.82.5-nightly
📦 litellmView on GitHub →
✨ 9 features🐛 15 fixes🔧 19 symbols
Summary
This release focuses heavily on bug fixes across the proxy, UI, and logging systems, alongside infrastructure improvements like black formatting and dependency updates. Key features include enhanced Anthropic integration and new control plane capabilities for multi-proxy management.
Migration Steps
- If you rely on the HTTP status code for non-existent keys being 401, note that /key/block and /key/unblock now return 404.
- If you rely on the HTTP status code for non-existent key updates being 401, note that the Key Update Endpoint now returns 404.
✨ New Features
- Added org admin access control, members_count, and indexes to the /v2/team/list endpoint.
- Surface Anthropic code execution results as code_interpreter_call in Responses API.
- Added external link icon to Learning Resources in the UI Leftnav.
- Preserve router model_group in generic API logs.
- Populate usage_metadata in outputs for the Cost column in Langsmith integration.
- Fix logging for response incomplete streaming + custom pricing on /v1/messages and /v1/responses.
- Use AZURE_DEFAULT_API_VERSION for proxy --api_version default.
- Support ANTHROPIC_AUTH_TOKEN and ANTHROPIC_BASE_URL environment variables for Anthropic provider.
- Added control plane for multi-proxy worker management.
🐛 Bug Fixes
- Auto-recover shared aiohttp session when closed.
- Model-level guardrails were not executing for non-streaming post_call in the proxy.
- Prevented duplicate callback logs for pass-through endpoint failures.
- Fixed Langfuse otel traceparent propagation.
- Guardrail Mode Type Crash on Non-String Values in UI Logs.
- Added Missing Permission Options in UI - Default Team Settings.
- Fixed /key/block and /key/unblock endpoints returning 404 (instead of 401) for non-existent keys.
- Fixed Key Update Endpoint returning 401 instead of 404 for Nonexistent Keys.
- Fixed thinking blocks being dropped when the thinking field is null.
- Fixed proxy only failure call type.
- Fixed model repetition detection performance.
- Upgraded mcp to 1.26.0.
- Added team_member_budget_duration to NewTeamRequest in the proxy.
- Added missing team_member_budget_duration param to new_team docstring.
- Mocked get_auth_header instead of get_api_key in anthropic file content test.