●Change8

v1.80.11-stable

📦 litellmView on GitHub →
✨ 14 features🐛 20 fixes🔧 7 symbols

Summary

This release introduces significant new features like Guardrails Load Balancing, Unified Skills API, and a new Rag Search API. It also includes numerous bug fixes across pricing, integrations (like Langfuse and Datadog), and UI elements, alongside performance improvements via lazy loading.

Migration Steps

  1. If using Datadog LLM Observability, be aware of changes to ensure correct callback execution alongside other integrations.

✨ New Features

  • Allow Platform admins to load balance between guardrails.
  • Unified Skills API now works across Anthropic, Vertex, Azure, and Bedrock.
  • Added new Rag Search API / Query API with rerankers.
  • Added Amazon Nova to sidebar and supported models list in README.
  • Added cost tracking for responses api in background mode.
  • Added support for stability model and bedrock stability model.
  • Added support for ocr for vertex ai deepseek model.
  • Added lazy loading for GaladrielChatConfig to reduce import memory overhead.
  • Added infrastructure recommendations to benchmarks documentation.
  • Added Health Check Model for Wildcard Model in UI.
  • Added Datadog log trace linking.
  • Enabled JSON-only provider routing and added xiaomi_mimo provider.
  • Added DBRX support on UI for Databricks provider.
  • Added vertexai and gemini veo 3.1 ga models.

🐛 Bug Fixes

  • Fixed Gemini 3 Flash pricing for Vertex AI.
  • Fixed guardrails for passthrough endpoint.
  • Fixed Claude code responses api bridge errors.
  • Fixed tool calls transformation in completion bridge for responses-api.
  • Fixed log_failure_event not working in langfuse.
  • Fixed Key Delete and Regenerate Permissions.
  • Fixed 'No module named 'fastapi'' error.
  • Fixed properties: should be non-empty for OBJECT type.
  • Removed example API keys with high entropy for security.
  • Reverted proxy_server_config.py changes.
  • Fixed Datadog LLM Observability ignoring dd base url override (initial attempt reverted, then fixed).
  • Fixed Datadog callback running alongside LLM Observability (conflict resolution).
  • Fixed MCP tool playground to allow editing ints and JSON payloads.
  • Fixed Vector Store Settings persistence in Team Update UI.
  • Fixed resolving Team ID to Team Alias in Usage Page UI.
  • Fixed responses-api tool results to use list format with input_text.
  • Fixed CI/CD tests related to logging, usage page visibility, security tests, openai realtime direct call, and code/doc quality checks.
  • Fixed budget alert emails and Cloudzero UI documentation.
  • Fixed spacing in documentation.
  • Fixed Key Info Page Internal Viewer Button Visibility.

🔧 Affected Symbols

GaladrielChatConfigdatadog llm obsresponses-apilangfuseGemini 3 FlashClaude code responses api bridgeDatabricks provider