●Change8

v1.80.0.dev1

Breaking Changes
📦 litellmView on GitHub →
⚠ 1 breaking✨ 20 features🐛 11 fixes⚡ 1 deprecations🔧 10 symbols

Summary

This release introduces significant UI enhancements, new model support (including Day 0 Gemini and Deepseek), and crucial backend refactoring for the MCP client lifecycle. It also includes various bug fixes across providers and UI components.

⚠️ Breaking Changes

  • Refactored MCPClient: Dropped direct usage of MCPClient.connect and now requires using the run_with_session lifecycle for operations.

Migration Steps

  1. If you were using MCPClient.connect, update your code to use the run_with_session lifecycle instead.

✨ New Features

  • Added SSML Support for Azure Text-to-Speech (AVA).
  • AI Gateway now allows admins to disable features and implement dynamic callback controls.
  • AI Gateway Auth: Added support for using JWTs for signing in with the Proxy CLI.
  • Added support for deepseek-v3p1-terminus and kimi-k2-instruct models in the model map.
  • Added managed files support for responses API.
  • Added support for Day 0 gemini-3-pro-preview.
  • Added Snowflake provider support, including embeddings, PAT, and account_id configuration.
  • Added support for the `strict` parameter in Anthropic tool schemas.
  • Added OCI Provider support, including the oci_endpoint_id parameter for OCI Dedicated Endpoints.
  • Enabled async content response for openai-video by inheriting BaseVideoConfig.
  • UI: Organization Usage displayed in the Usage Tab.
  • UI: Exposed backend endpoint for callbacks settings.
  • UI: Added Edit/Add callbacks route to use data from the backend.
  • UI: Added JSON Viewer to request/response panel.
  • UI: Added Delete user and MCP Server Modal, and MCP Table Tooltips.
  • UI: Added Teams table empty state.
  • UI: Added Fallbacks icon button tooltips and delete with friction.
  • UI: Allow setting base_url in API reference docs.
  • Agents: Made agents discoverable on the model hub page for internal discovery.
  • SSO: Ensured `role` from the SSO provider is used when a user is inserted onto LiteLLM.

🐛 Bug Fixes

  • Fixed a bug where keys never expired.
  • Fixed a UI MCP Tool Test Regression.
  • Fixed flaky UI tests caused by the antd Notification Manager.
  • Corrected Bedrock configurations for Haiku 4.5.
  • Fixed retrieval of custom_llm_provider from the query parameter.
  • Fixed prompt injection not working correctly.
  • Corrected wrong system message handling for gemma.
  • Fixed videos tagging.
  • Added None check for litellm_params.
  • Updated Azure Pricing.
  • Fixed an issue where openai-video needed to inherit BaseVideoConfig to enable async content response.

🔧 Affected Symbols

MCPClientAzure Text-to-Speech (AVA)deepseek-v3p1-terminuskimi-k2-instructgemini-3-pro-previewSnowflake providerAnthropic tool schemasOCI Provideropenai-videogemma

⚡ Deprecations

  • Removed a deprecated embedding model.