v1.80.11-nightly
📦 litellmView on GitHub →
✨ 20 features🐛 28 fixes🔧 16 symbols
Summary
This release adds numerous new features such as Guardrails load balancing, a unified Skills API, and expanded model support, while delivering a large set of bug fixes and performance improvements across CI/CD, UI, and observability components.
✨ New Features
- Guardrails Load Balancing for Platform admins
- Unified Skills API supporting Anthropic, Vertex, Azure, Bedrock
- New RAG Search API / Query API with rerankers
- Amazon Nova added to supported models list
- Support for OCR for Vertex AI DeepSeek model
- Cost tracking for responses API in background mode
- Support for Stability AI model and Bedrock Stability model
- Delete Cloudzero Settings Route
- UI: Cloudzero Delete Settings
- Auto Resolve Vector Store Embedding Model Config
- Lazy loading for GaladrielChatConfig to reduce import memory overhead
- Infrastructure recommendations added to benchmarks documentation
- Lazy load 41 configuration classes
- UI: Add Health Check Model for Wildcard Model
- UI: Resolve Team ID to Team Alias on Usage Page
- UI: Change Delete Model and Key Modals
- UI: Refactor components to use reusable component
- Datadog log trace linking feature
- Enable JSON‑only provider routing and add xiaomi_mimo provider
- Add version requirement note for Gemini 3 Flash model
🐛 Bug Fixes
- CI/CD logging_testing fix
- UI Usage Page Top Key View Button visibility fix
- Gemini 3 Flash pricing fix for Vertex AI
- Readme typo and link fixes
- CI/CD missing documentation for ENVs & clean functionality fix
- CI/CD local_testing & mapped tests fix (reverted later)
- Guardrails passthrough endpoint fix
- Claude code responses API bridge error fix
- Secret manager settings documentation improvement
- Tool calls transformation fix in completion bridge
- log_failure_event not working in Langfuse fixed
- Key Delete and Regenerate permissions fix
- FastAPI missing module error fix
- Object type properties non‑empty validation fix
- Security: removed example API keys with high entropy
- Key Info Page internal viewer button visibility fix
- UI Persist Vector Store Settings in Team Update fix
- Responses API: use list format with input_text for tool results
- Datadog LLM observability base URL override ignored fix (reverted later)
- Datadog callback runs alongside LLM observability fix (reverted later)
- Datadog dual callback conflict fix
- MCP tool playground allows editing ints and JSON payloads
- Databricks provider UI fix adding DBRX
- CI/CD responses_api_testing fix
- CI/CD test_users_in_team_budget fix
- CI/CD security_tests fix
- CI/CD test_openai_realtime_direct_call_with_intent fix
- CI/CD check_code_and_doc_quality fix