Change8

v1.82.3-stable.patch.3

📦 litellmView on GitHub →
3 features🐛 6 fixes

Summary

This patch release introduces new UI features for rate limiting and credential exposure, adds embedding usage tracking fallback, and includes several UI and Docker build bug fixes. It also details how to verify the integrity of LiteLLM Docker images using cosign.

Migration Steps

  1. Users deploying Docker images should verify image signatures using the provided cosign commands (recommended using the pinned commit hash).

✨ New Features

  • Added per-model rate limits to team edit/info views in the UI.
  • Exposed Azure Entra ID credential fields in the provider form in the UI.
  • Added embedding usage tracking fallback in Triton.

🐛 Bug Fixes

  • Fixed wiring of team_id filter to key alias dropdown on Virtual Keys tab in the UI.
  • Fixed paginated team search on the usage page filter in the UI.
  • Fixed requirement of TPM or RPM when adding a per-model team rate limit in the UI.
  • Added missing useInfiniteTeams hook needed by team_multi_select in the UI.
  • Fixed logs guardrail mode type crash when encountering non-string values.
  • Backported non-root Dockerfile build fixes from main.