v1.82.2-dynamoai.dev
📦 litellmView on GitHub →
✨ 9 features🐛 28 fixes🔧 8 symbols
Summary
This release focuses heavily on bug fixes, infrastructure improvements, and significant updates to the UI, including new endpoints and administrative features. Key fixes address security vulnerabilities, proxy stability, and various provider integrations.
Migration Steps
- If encountering database migration failures on pre-existing instances, consider using the --enforce_prisma_migration_check flag to opt-out of the failure exit behavior.
✨ New Features
- Introduced User Info V2 Endpoint.
- Added functionality to allow setting organization_id on Key Update.
- UI: Added Organization Dropdown to Create/Edit Key functionality.
- UI: Added functionality for Internal Users to Add/Remove Team Membership.
- Added Vantage integration for FOCUS CSV export.
- UI: Modernized Default Team Settings page and fixed defaults application.
- UI: Implemented auto-pagination for daily spend data in Usage section.
- Added sagemaker_nova provider for Amazon Nova models on SageMaker.
- Added CodSpeed continuous performance benchmarks.
🐛 Bug Fixes
- Fixed typos in Auth Error Messages.
- Resolved issue where Public Model Hub was not showing Config-Defined Models.
- Prevented OOM/Prisma connection loss from unbounded managed-object poll in proxy.
- Updated outdated test_responses_background_cost Assertions.
- Forwarded extra_headers to HuggingFace embedding API.
- Fixed fallback popup model dropdown z-index issue.
- Added _remove_scope_from_cache_control for Bedrock and Azure.
- Auto-filled reasoning_content for moonshot kimi reasoning models.
- Handled response.failed, response.incomplete, and response.cancelled states.
- Bumped tar to 7.5.11 and tornado to 6.5.5 for security.
- Fixed _supports_reasoning_effort_level for responses bridge.
- Fixed preservation of native tool format when guardrails convert tools for Anthropic Messages API.
- Added Azure Model Router cost breakdown in UI and included additional_costs from hidden_params.
- Fixed silent metrics race condition.
- Fixed tiktoken cache nonroot offline issue.
- Normalized content_filtered finish_reason.
- Fixed Tag list endpoint 500 error caused by invalid Prisma group_by kwargs.
- Fixed Responses bridge variable mismatch and outdated CI tests.
- Fixed custom cost tracking on deployments for /v1/messages and /v1/responses.
- Fixed Langfuse failure path kwargs inconsistency.
- Fixed Responses Bridge Overwrite on Second Bridge Check.
- Fixed Team Admin 403 error on /user/filter/ui With Org Scope Flag.
- Redacted secrets from proxy log output.
- Fixed prisma migrate deploy failures on pre-existing instances.
- Fixed hanging CI Tests in custom_httpx test_http_handler.
- Bumped PyJWT to ^2.12.0 for security.
- Centralized logging update to use 1 function for centralized kwarg updates.
- Made db migration failure exit opt-in via --enforce_prisma_migration_check.