●Change8

v1.82.2-focus-export-2.dev

📦 litellmView on GitHub →
✨ 12 features🐛 21 fixes🔧 17 symbols

Summary

This release introduces several new UI features, including user info endpoints and team management tools, alongside numerous bug fixes addressing issues in proxy stability, cost tracking, and API integrations. Dependency updates for security were also performed.

Migration Steps

  1. If you rely on specific error messages for authentication, review them as typos were corrected.
  2. If using custom cost tracking on deployments for /v1/messages and /v1/responses, verify configuration due to fixes.

✨ New Features

  • Introduced User Info V2 Endpoint.
  • Added functionality to allow setting organization_id on Key Update.
  • UI: Added Organization Dropdown to Create/Edit Key interface.
  • Forward extra_headers to HuggingFace embedding API.
  • Auto-fill reasoning_content for moonshot kimi reasoning models.
  • Handle response states: response.failed, response.incomplete, and response.cancelled.
  • Added support for Azure Model Router cost breakdown in UI and retrieval of additional_costs from hidden_params.
  • UI: Added functionality for Internal Users to Add/Remove Team Membership.
  • Added Vantage integration for FOCUS CSV export.
  • UI: Modernized Default Team Settings page and fixed defaults application.
  • UI: Implemented auto-pagination for daily spend data in Usage section.
  • Added sagemaker_nova provider for Amazon Nova models on SageMaker.

🐛 Bug Fixes

  • Fixed typos in Auth Error Messages.
  • Resolved issue where Public Model Hub was not showing Config-Defined Models.
  • Prevented OOM/Prisma connection loss from unbounded managed-object poll in proxy.
  • Updated outdated test_responses_background_cost Assertions.
  • Fixed fallback popup model dropdown z-index issue.
  • Implemented _remove_scope_from_cache_control for Bedrock and Azure.
  • Fixed _supports_reasoning_effort_level for responses bridge.
  • Fixed issue where Anthropic guardrails converted tools incorrectly for Anthropic Messages API, preserving native tool format.
  • Fixed silent metrics race condition.
  • Fixed tiktoken cache issue for nonroot offline usage.
  • Normalized content_filtered finish_reason.
  • Fixed Tag list endpoint 500 error caused by invalid Prisma group_by kwargs.
  • Fixed Responses bridge variable mismatch and outdated CI tests.
  • Fixed custom cost tracking on deployments for /v1/messages and /v1/responses endpoints.
  • Fixed Langfuse failure path kwargs inconsistency.
  • Fixed Responses Bridge Overwrite issue on Second Bridge Check.
  • Fixed Team Admin 403 error on /user/filter/ui when Org Scope Flag was present.
  • Redacted secrets from proxy log output.
  • Fixed prisma migrate deploy failures on pre-existing instances.
  • Fixed hanging CI Tests in custom_httpx test_http_handler.
  • Fixed redaction filter logging v2.

Affected Symbols

User Info V2 EndpointKey Update functionHuggingFace embedding APImoonshot kimi reasoning modelsBedrockAzur...Anthropic Messages APIAzure Model RouterVantage FOCUS CSV exportDefault Team Settings pageTag list endpointUsage daily spend data endpointResponses bridgesagemaker_nova providerproxy log outputprisma migrate deploycustom_httpx test_http_handler