v1.83.9-nightly
📦 litellmView on GitHub →
✨ 4 features🐛 22 fixes🔧 2 symbols
Summary
This release introduces Docker image signature verification via cosign and includes numerous bug fixes across proxy security, caching, Bedrock handling, and UI components. Infrastructure updates also stabilized CI/CD processes.
Migration Steps
- Users running LiteLLM via Docker images should verify image signatures using the provided cosign commands to ensure image authenticity, preferably using the pinned commit hash.
- If using custom guardrail code, note that the sandbox has been switched from custom_code to RestrictedPython.
✨ New Features
- Introduced support for retrying Anthropic /v1/messages after an invalid thinking signature.
- Added BACKGROUND_HEALTH_CHECK_MAX_TOKENS environment variable for health checks.
- Exposed per-server InitializeResult.instructions from the gateway for MCP.
- Added support for Litellm day 0 opus 4.7.
🐛 Bug Fixes
- Hardened CORS credentials handling.
- Improved exception handling for create_views.
- Cleaned up the spend log loop.
- Populated standard_logging_object via logging hook for Azure passthrough.
- Added Responses API parameters to the cache key allow-list.
- Fixed UI policy attachment deletion via controlled modal.
- Enforced team membership in team-scoped key management checks in the proxy.
- Fixed accurate cache token cost breakdown in UI and SpendLogs for Bedrock/Anthropic.
- Handled null type responses for Bedrock API.
- Prevented API key leaks in error tracebacks, logs, and alerts.
- Replaced custom_code sandbox with RestrictedPython for guardrails.
- Made PodLockManager.release_lock atomic compare-and-delete (re-land of #21226).
- Optimized database query to prevent OOM errors during health checks.
- Preserved provider response headers in StandardLoggingPayload.
- Hardened request parameter handling in the proxy.
- Added shared path utilities and prevented directory traversal in the proxy.
- Fixed virtual key projected-spend soft budget alerts in the proxy.
- Fixed rendering of guardrail optional_params bool defaults in UI Select.
- Used antd Select for MCP ToolTestPanel bool inputs in the UI.
- Invalidated org queries after team mutations in the UI.
- Removed dead Bedrock clear_thinking interleaved-thinking-beta assertion in tests.
- Mocked Bedrock Moonshot tests and fixed TogetherAIConfig recursion.