v1.78.5-nightly
📦 litellm
✨ 3 features🐛 4 fixes🔧 1 symbols
Summary
This release introduces team-level rate limiting controls and enhances guardrail capabilities with content masking and streaming support. Several bug fixes address memory leaks and configuration handling in the proxy server.
✨ New Features
- Added team-level model-specific TPM/RPM limits.
- Implemented working key-level validation of TPM/RPM limits when assigned to a team.
- Added content masking and streaming support to the PANW Prisma AIRS guardrail.
🐛 Bug Fixes
- Fixed a memory leak by ensuring pass-through routes are only added when the path does not already exist.
- Fixed an issue in proxy_server.py by re-encrypting environment variables on config save and using the original value upon decryption error.
- Added support for 'service_tier' in chat completion.
- Added 'imagePullSecrets' to migrations-job.
🔧 Affected Symbols
proxy_server.py