●Change8

v1.80.11.rc.1

📦 litellm
✨ 21 features🐛 25 fixes🔧 22 symbols

Summary

This release adds several new capabilities such as Guardrails load‑balancing, a unified Skills API, Rag Search and Query APIs with rerankers, and expanded model support, while also delivering numerous bug fixes and performance improvements across CI/CD, UI, and observability components.

✨ New Features

  • Guardrails Load Balancing - Allow Platform admins to load balance between guardrails
  • Unified Skills API - works across Anthropic, Vertex, Azure, Bedrock
  • Add new Rag Search API / Query API with rerankers
  • Add Amazon Nova to sidebar and under supported models in README
  • Add support for OCR for Vertex AI DeepSeek model
  • Add cost tracking for responses API in background mode
  • Add support for stability model and Bedrock stability model
  • Delete Cloudzero Settings Route
  • UI - Cloudzero Delete Settings
  • Auto Resolve Vector Store Embedding Model Config
  • Add lazy loading for GaladrielChatConfig to reduce import memory overhead
  • Lazy load 41 configuration classes
  • UI - Add Health Check Model for Wildcard Model
  • UI - Resolve Team ID to Team Alias in Usage Page
  • Change Delete Model and Key Modals
  • Changing some components to use reusable component
  • Datadog log trace linking
  • Enable JSON-only provider routing and add xiaomi_mimo provider
  • Add version requirement in Gemini 3 Flash blog
  • Add vertexai and gemini veo 3.1 GA models
  • UI - Fix Databricks provider - adding DBRX on UI

🐛 Bug Fixes

  • CI/CD - logging_testing
  • UI - Usage Page Top Key View Button Visibility
  • Fix Gemini 3 Flash pricing for Vertex AI
  • CI/CD - Add missing documentation for ENVs & Clean Functionality
  • CI/CD - local_testing & mapped tests
  • Revert CI/CD - local_testing & mapped tests
  • Fix guardrails for passthrough endpoint
  • Fix Claude code responses API bridge errors
  • Fix tool calls transformation in completion bridge (responses-api)
  • Fix not working log_failure_event in Langfuse
  • Key Delete and Regenerate Permissions Fix
  • Fix No module named 'fastapi'
  • Fix properties: should be non-empty for OBJECT type
  • Security - Remove example API keys with high entropy
  • UI - Persist Vector Store Settings in Team Update
  • UI - Key Info Page Internal Viewer Button Visibility
  • CI/CD - responses_api_testing
  • CI/CD - test_users_in_team_budget
  • CI/CD - security_tests
  • CI/CD - test_openai_realtime_direct_call_with_intent
  • CI/CD - check_code_and_doc_quality
  • Fix Datadog callback runs alongside LLM Observability
  • Litellm fix Datadog dual callback conflict
  • Allow MCP tool playground to edit ints and JSON payloads
  • Fix Databricks provider - adding DBRX on UI

🔧 Affected Symbols

GuardrailsLoadBalancingUnifiedSkillsAPIRagSearchAPIQueryAPIAmazonNovaOCRVertexAICostTrackingBackgroundStabilityModelCloudzeroSettingsRouteVectorStoreEmbeddingModelConfigGaladrielChatConfigDatadogCallbackproxy_server_configresponses_apitool_calls_transformationLangfuseLogFailureEventClaudeCodeResponsesBridgeFastAPIDatabricksProviderMCPToolPlaygroundJSONOnlyProviderRoutingXiaomiMimoProvider