v1.83.6-nightly
📦 litellmView on GitHub →
✨ 7 features🐛 13 fixes🔧 2 symbols
Summary
This release introduces Docker image signature verification using cosign, adds new API endpoints and features like Ramp callbacks, and includes numerous bug fixes across routing, cost calculation, and Docker builds.
Migration Steps
- Users deploying Docker images should verify image signatures using the pinned commit hash or release tag as detailed in the documentation.
✨ New Features
- Added POST /team/permissions_bulk_update endpoint.
- Added support for AWS Gov Cloud mode in LiteLLM.
- Added Ramp as a built-in success callback.
- Added embedding usage estimation for self-hosted responses via Triton.
- Added baseten model API pricing entries.
- Added credential overrides per team/project via model_config metadata in Proxy.
- Added per-user OAuth token storage for interactive MCP flows.
🐛 Bug Fixes
- Fixed batch-limit stale managed object cleanup to prevent large database UPDATES.
- Updated check_responses_cost tests for _expire_stale_rows.
- Handled missing .npmrc gracefully in Dockerfile.non_root.
- Allowed JWT to override OAuth2 routing without global OAuth2 enablement.
- Fixed node-gyp symlink path after npm upgrade in Dockerfile.
- Blocked arbitrary command execution via stdio transport in MCP.
- Fixed tag-based routing when encrypted_content_affinity is enabled.
- Fixed passing custom_llm_provider to get_llm_provider for unprefixed model names.
- Mocked headers in test_completion_fine_tuned_model.
- Improved storage handling and Dockerfile consistency in UI.
- Fixed responses WebSocket backend URL by appending ?model=.
- Fixed Responses WebSocket Duplicate Keyword Argument Error.
- Avoided double-counting cache tokens in Anthropic Messages streaming usage for Bedrock.