●Change8

v1.83.11-nightly

📦 litellmView on GitHub →
✨ 6 features🐛 8 fixes⚡ 1 deprecations🔧 5 symbols

Summary

This release introduces Docker image signing verification via cosign and adds several features including proxy hot-reloading and audio support for Scaleway. It also includes numerous infrastructure improvements and bug fixes across Bedrock integration and CI stability.

Migration Steps

  1. If you rely on the retired model alias 'claude-3-haiku-20240307', update your configuration to use 'claude-haiku-4-5-20251001'.

✨ New Features

  • Added --reload flag for uvicorn hot reload in the LiteLLM proxy (development only).
  • Added audio support for Scaleway models.
  • Integrated Prompt Compression feature into the LiteLLM proxy.
  • Added support for the bedrock-mantle endpoint (Claude Mythos Preview) on AWS Bedrock.
  • Introduced an opt-in v2 migration resolver for the Proxy.
  • Implemented individual team member budgets.

🐛 Bug Fixes

  • Fixed a bug causing a 503 loop on the /health/readiness endpoint when the database is unreachable.
  • Applied black formatting to resolve CI lint failures.
  • Fixed CI issue in auth_ui_unit_tests by using a Postgres sidecar instead of a shared DB.
  • Fixed CI issue related to e2e_ui_testing tests using stale bundles on Ubuntu (due to cp -r merge semantics).
  • Aligned user and organization budget spend checks with an atomic counter pattern.
  • Fixed Bedrock Invoke body field allowlisting and filtering of all anthropic-beta values.
  • Added 'litellm_call_id' to StandardLoggingPayload and OpenTelemetry (OTel) spans for improved logging.
  • Fixed Bedrock guardrails to use the Bedrock OUTPUT source when scanning model responses for guardrail application.

Affected Symbols

uvicornscalewaybedrockStandardLoggingPayloadOTel span

⚡ Deprecations

  • The retired model alias 'claude-3-haiku-20240307' has been updated to 'claude-haiku-4-5-20251001'.