v1.80.16-nightly
📦 litellmView on GitHub →
✨ 7 features🐛 27 fixes🔧 4 symbols
Summary
This release focuses heavily on bug fixes across various providers (Gemini, Anthropic, OCI) and internal systems like guardrails and pricing. It also introduces several UI enhancements and infrastructure updates, including Helm chart versioning sync.
✨ New Features
- Added OpenAI-compatible service_tier parameter translation for Bedrock.
- Supported token IDs (list of integers) as prompt for text completion.
- Added all chat replicate models support.
- Added /organization/list Query Params to UI.
- Added Organization Table Filters to UI.
- Added UI Feedback Form - why LiteLLM.
- Added ability to override MSFT SSO env var attribute names.
🐛 Bug Fixes
- Stabilized db_migration_disable_update_check test log check.
- Respected pangea guardrail default_on during initialization.
- Prevented duplicate MCP reload scheduler registration.
- Corrected pricing for openrouter/openai/gpt-oss-20b.
- Fixed missing completion_tokens_details in gemini 3 flash when reasoning_effort is not used.
- Added created_at/updated_at fields to LiteLLM_ProxyModelTable.
- Forwarded extra_headers in generateContent adapter for google_genai.
- Fixed SerializationIterator error and passed tools to guardrail.
- Prevented dropping thinking when any message has thinking_blocks in Anthropic.
- Included IMAGE token count in cost calculation for Gemini models.
- Fixed negative text_tokens when using cache with images for Gemini.
- Synced Helm chart versioning with production standards and Docker versions.
- Handled OpenAI-style image_url object in multimodal messages for OCI.
- Added presence_penalty support for Google AI Studio for Gemini.
- Preserved web_fetch_tool_result in multi-turn conversations for Anthropic.
- Added Custom CA certificates to boto3 clients.
- Fixed model id encoding for bedrock passthrough.
- Respected max_completion_tokens in thinking feature.
- Fixed Gemini Image Generation: imageConfig parameters.
- Fixed guardrail moderation support with responses API.
- Fixed header forwarding for embeddings endpoint.
- Included proxy/prisma_migration.py in non-root builds.
- Added missing anthropic tool results in response.
- Added allowClear to dropdown components for better UX.
- Forwarded MCP extra headers case-insensitively.
- Fixed batch deletion and retrieve.
- Fixed MSFT SSO to allow setting custom MSFT Base URLs.