v1.82.6.rc.4
📦 litellmView on GitHub →
✨ 4 features🐛 9 fixes
Summary
This release introduces Docker image signing verification using cosign and adds significant new features to the router, including order-based fallback and health-check-driven routing. Several routing and Docker build fixes were also implemented.
Migration Steps
- Users deploying Docker images should verify image signatures using the provided cosign commands (pinned commit hash recommended).
✨ New Features
- Order-based fallback across deployment priority levels in the router.
- Added health-check-driven routing behind an opt-in flag.
- Added health_check_ignore_transient_errors flag for health check routing.
- Integrated allowed_fails_policy into health check failures.
🐛 Bug Fixes
- Prevented cross-team deployment leakage in the fallback path.
- Prevented stale model_aliases from interfering with team routing.
- Query DB directly for sibling deployments on rename.
- Fixed P0 cooldown integration never firing in health-check-routing.
- Fixed P1 transient-error filter being broken on cache hits.
- Addressed Greptile review feedback on key rotation lock.
- Included enterprise bridge in non-root runtime Docker image.
- Guarded .npmrc mv in non-root Dockerfile.
- Synced circleci config with main and added node-gyp fix for non-root Dockerfile.