●Change8

v1.80.7.dev.2

Breaking Changes
📦 litellmView on GitHub →
⚠ 3 breaking✨ 27 features🐛 28 fixes⚡ 2 deprecations🔧 23 symbols

Summary

This release introduces a rebuilt UI, numerous new providers and model support, extensive guardrail enhancements, and many bug fixes, while deprecating the old `spend/logs` endpoint and removing feature flags.

⚠️ Breaking Changes

  • The `spend/logs` endpoint has been removed; use `spend/logs/v2` instead. Update any client calls to the new endpoint.
  • The beta Bedrock header is no longer supported; remove the header or switch to the standard header format.
  • Feature flags have been removed from the codebase; any conditional logic relying on them must be deleted or replaced.

Migration Steps

  1. Replace all calls to `/spend/logs` with `/spend/logs/v2`.
  2. Remove any usage of the deprecated beta Bedrock header and adopt the standard header format.
  3. Search code for `feature_flags` checks and delete or replace them with explicit configuration.

✨ New Features

  • Rebuilt UI with new components and loading states.
  • Added OpenAI Agents SDK documentation.
  • Added guardrails for pass‑through endpoints.
  • UI now allows adding pass‑through guardrails.
  • Added provider `publicai.co`.
  • Added button loading states to Edit Settings UI.
  • Wildcard routes for non‑proxy admin (SCIM) are now supported.
  • Added Nova embedding support.
  • Added support for Twelve Labs Pegasus model.
  • Passthrough cost tracking added for VEO.
  • Improved image generation handling for Gemini models.
  • WatsonX now allows passing `zen_api_key` dynamically.
  • JWT Auth for AI Gateway now supports regular OIDC flow with user‑info endpoints.
  • Added new model `fireworks_ai/kimi-k2-instruct-0905`.
  • Generic Guardrail API enables instant provider support without repository PRs.
  • Added `claude-opus-4-5` alias to pricing data.
  • Audio transcription support added for OVHcloud.
  • Added Z.AI (Zhipu AI) as a built‑in provider.
  • Experimental latest‑user filtering for Bedrock.
  • Context‑window exception mapping added for Together AI.
  • Embedding API support added for GitHub Copilot.
  • Databricks model pricing updated and new models added.
  • `vllm` batch+files API support added.
  • Additional routes added to JWT authentication.
  • Bedrock OpenAI model support added.
  • Cost tracking for responses API added.
  • Improved anonymization handling.

🐛 Bug Fixes

  • Do not include plaintext message in exception handling.
  • Fixed Add Fallback modal to use Antd Select.
  • Vector Store List endpoint now returns correct status instead of 404.
  • Fixed Request and Response panel JSON viewer rendering.
  • Fixed UI fallback deletion race condition before API resolves.
  • Removed stale feature flags from code.
  • Migrated Anthropic provider to Azure AI.
  • Streaming error validation fixed (issue 16759).
  • Regex‑based tool_name/tool_type matching for tool‑permission added.
  • Fixed generic SSO provider handling.
  • Handled Cohere v4 embed response dictionary format in Bedrock.
  • Fixed acompletion errors with SambaNova models.
  • Metadata tags and model name display fixed for Azure passthrough.
  • Improved handling of anonymization edge cases.
  • Fixed guardrail mock_response handling during calls.
  • Session consistency fixed and Lasso API version moved out of source code.
  • Fixed WatsonX audio transcription API.
  • Fixed extra_headers handling in Bedrock messages API.
  • Corrected GA path for Azure OpenAI realtime models.
  • `litellm_enterprise` import routes now exist.
  • Fixed organization team validation against org.
  • SSO users now correctly added to Entra‑synced teams.
  • Fixed AttributeError when metadata is null in request body.
  • Removed URL format validation for MCP server endpoints.
  • Updated default database connection pool size.
  • Updated default proxy batch write size.
  • Fixed 500 error for malformed requests.
  • Fixed LiteLLM user authentication passing issue.

🔧 Affected Symbols

spend/logsspend/logs/v2bedrockguardrailjwt_authvllmaudio/speechSSOanthropicazure_openailitellm_enterprisevector_storeuiprovider_publicaiprovider_zaiprovider_novaprovider_twelvelabs_pegasusprovider_ovhcloudprovider_fireworks_aiprovider_watsonxprovider_geminiprovider_together_aiprovider_github_copilot

⚡ Deprecations

  • `spend/logs` endpoint is deprecated in favor of `spend/logs/v2`.
  • Feature flags are deprecated and have been removed.