v1.81.14.dev.2
📦 litellmView on GitHub →
✨ 5 features🐛 9 fixes🔧 6 symbols
Summary
This release focuses heavily on UI modernization, especially around Teams features, and includes numerous fixes across various providers like Bedrock, Gemini, and Anthropic. A new control plane for multi-proxy worker management was also introduced.
Migration Steps
- If you rely on the cost calculation for audio transcription models, note that the initial fix was reverted; review PR #24297 for details on the reverted change.
✨ New Features
- Modernized Teams Table UI.
- Introduced Team MCP Server Manager Role (though this was later reverted).
- Added control plane for multi-proxy worker management.
- Enabled context circulation for server-side tool combination in Gemini.
- Added support for cache_control_injection_points for tool_config location in Bedrock.
🐛 Bug Fixes
- Fixed AntD Messages Not Rendering in UI.
- Fixed count_tokens endpoint in Bedrock to respect api_base and aws_bedrock_runtime_endpoint.
- Fixed Gemini embeddings to convert task_type to camelCase taskType for Gemini API.
- Fixed merging of hidden_params into metadata for streaming requests in logging.
- Fixed cost_per_second calculation for audio transcription models (though this fix was later reverted).
- Fixed Moonshot to preserve reasoning_content on Pydantic Message objects in multi-turn tool calls.
- Added team_member_budget_duration to NewTeamRequest in proxy.
- Fixed Anthropic adapter to add additionalProperties: false for OpenAI strict mode.
- Mocked get_auth_header instead of get_api_key in an Anthropic file content test.