v1.78.4.dev1
📦 litellmView on GitHub →
✨ 1 features🐛 3 fixes🔧 3 symbols
Summary
This release introduces Global Cross-Region Inference for Bedrock and includes several bug fixes related to token counting, budget settings, and Bedrock/MCP integration.
✨ New Features
- Added Global Cross-Region Inference support for bedrock-pricing-geo-inregion-cross-region.
🐛 Bug Fixes
- Fixed an issue where the token counter failed to extract model_info from deployment for custom_tokenizer.
- Resolved an error related to Max Budget removal in litellm_Key Settings.
- Improved Bedrock + MCP integration, enabling working MCP calls to bedrock via Responses API and logging hidden parameters for OTEL calls.
🔧 Affected Symbols
token-counterlitellm_Key Settingsbedrock-pricing-geo-inregion-cross-region