v1.78.5-stable
📦 litellmView on GitHub →
✨ 3 features🐛 4 fixes🔧 1 symbols
Summary
This release introduces team-level rate limit controls and enhances guardrail capabilities with content masking and streaming support for PANW Prisma AIRS. Several bug fixes address memory leaks and configuration handling.
✨ New Features
- Added team-level model-specific TPM/RPM limits.
- Implemented working key-level validation of TPM/RPM limit when assigned to a team.
- Added content masking and streaming support to the PANW Prisma AIRS guardrail.
🐛 Bug Fixes
- Fixed a memory leak by ensuring pass-through routes are only added when the path does not already exist.
- Fixed an issue in proxy_server.py by re-encrypting environment variables on config save and using the original value upon decrypt error.
- Added support for 'service_tier' in chat completion.
- Added 'imagePullSecrets' to migrations-job.
🔧 Affected Symbols
proxy_server.py