v1.80.15.dev1
📦 litellmView on GitHub →
✨ 4 features🐛 23 fixes🔧 3 symbols
Summary
This release focuses heavily on bug fixes across various providers like Gemini, Anthropic, and OCI, alongside adding new features such as Bedrock service tier translation and support for replicate chat models. It also includes documentation updates regarding load balancing and Redis requirements.
Migration Steps
- If using Pangea guardrails, ensure default_on is correctly set during initialization if you rely on its default state.
✨ New Features
- Added OpenAI-compatible service_tier parameter translation for Bedrock.
- Added support for token IDs (list of integers) as prompt for text completion.
- Added support for all chat replicate models.
- Added steps-to-reproduce section in bug report template.
🐛 Bug Fixes
- Stabilized db_migration_disable_update_check test log check.
- Respect pangea guardrail default_on during initialization.
- Prevented duplicate MCP reload scheduler registration.
- Corrected pricing for openrouter/openai/gpt-oss-20b.
- Fixed missing completion_tokens_details in gemini 3 flash when reasoning_effort is not used.
- Added created_at/updated_at fields to LiteLLM_ProxyModelTable.
- Forwarded extra_headers in generateContent adapter for google_genai.
- Fixed SerializationIterator error and passed tools to guardrail.
- Prevented dropping thinking when any message has thinking_blocks in Anthropic.
- Included IMAGE token count in cost calculation for Gemini models.
- Fixed negative text_tokens when using cache with images for Gemini.
- Synced Helm chart versioning with production standards and Docker versions.
- Handled OpenAI-style image_url object in multimodal messages for OCI.
- Added presence_penalty support for Google AI Studio in Gemini.
- Preserved web_fetch_tool_result in multi-turn conversations for Anthropic.
- Added Custom CA certificates to boto3 clients.
- Fixed model id encoding for bedrock passthrough.
- Respected max_completion_tokens in thinking feature.
- Fixed Gemini Image Generation: imageConfig parameters.
- Fixed header forwarding for embeddings endpoint.
- Included proxy/prisma_migration.py in non-root contexts.
- Added missing Anthropic tool results in response.
- Added allowClear to dropdown components for better UX.