Change8

v1.81.5-nightly

📦 litellmView on GitHub →
4 features🐛 7 fixes🔧 3 symbols

Summary

This release focuses on stability, introducing features like Bedrock converse caching and configurable CLI JWT expiration, alongside numerous bug fixes and infrastructure improvements to stabilize testing.

✨ New Features

  • UI: Implemented auto truncation of table values for Virtual Keys.
  • Messages API: Added Bedrock converse caching and PDF support.
  • Enabled progress notifications for MCP tool calls.
  • CLI Auth: Added configurable CLI JWT expiration via environment variable.

🐛 Bug Fixes

  • Fixed an arguments issue and refactored code into a helper function.
  • Fixed proxy logic to correctly use the return value from CustomLogger.async_post_call_success_hook.
  • Fixed server root path issue.
  • Fixed UI bug preventing clearing of content filter patterns when editing a guardrail.
  • Fixed issue where user max budget could not be reset to unlimited.
  • Made HTTPHandler mockable in OIDC secret manager tests.
  • Fixed broken mocks in 6 flaky tests to prevent real API calls.

Affected Symbols