v1.81.14.dev.3
📦 litellmView on GitHub →
✨ 5 features🐛 9 fixes🔧 6 symbols
Summary
This release focuses heavily on UI modernization, infrastructure improvements including a control plane for worker management, and numerous fixes across various providers like Bedrock, Gemini, and Moonshot. Several documentation updates regarding pricing and caching were also included.
Migration Steps
- If relying on the Team MCP Server Manager Role feature, note that it was reverted and may require re-implementation or checking subsequent releases.
✨ New Features
- Modernized Teams Table in UI.
- Introduced Team MCP Server Manager Role (though this was later reverted).
- Added control plane for multi-proxy worker management.
- Enabled context circulation for server-side tool combination in Gemini.
- Added support for cache_control_injection_points for tool_config location in Bedrock.
🐛 Bug Fixes
- Fixed AntD Messages Not Rendering in UI.
- Fixed count_tokens endpoint in Bedrock to respect api_base and aws_bedrock_runtime_endpoint.
- Fixed Gemini embeddings to convert task_type to camelCase taskType for Gemini API.
- Fixed merging of hidden_params into metadata for streaming requests in logging.
- Fixed cost_per_second calculation for audio transcription models (Note: This fix was later reverted).
- Fixed Moonshot to preserve reasoning_content on Pydantic Message objects in multi-turn tool calls.
- Added team_member_budget_duration to NewTeamRequest in proxy.
- Fixed Anthropic adapter to add additionalProperties: false for OpenAI strict mode.
- Fixed test in anthropic file content test by mocking get_auth_header instead of get_api_key.