●Change8

v1.82.6.dev.1

📦 litellmView on GitHub →
✨ 8 features🐛 18 fixes🔧 7 symbols

Summary

This release focuses heavily on UI modernization, especially around Teams and MCP management, alongside numerous bug fixes for proxy guardrails, logging, and key management endpoints. It also introduces infrastructure improvements and new environment variable support for Anthropic.

Migration Steps

  1. If using Anthropic, ensure ANTHROPIC_AUTH_TOKEN and ANTHROPIC_BASE_URL environment variables are set if needed for configuration.
  2. If relying on specific error codes for key management, note that /key/block and /key/unblock now return 404 for non-existent keys instead of 401.

✨ New Features

  • Added org admin access control, members_count, and indexes to /v2/team/list endpoint.
  • Introduced a control plane for multi-proxy worker management.
  • Added support for ANTHROPIC_AUTH_TOKEN and ANTHROPIC_BASE_URL environment variables for Anthropic.
  • Implemented MCP team management with per-member granular permissions.
  • Added UI features for MCP team member permissions drawer and CRUD access.
  • Added access control via object permissions for Search Tools.
  • Added external link icon to Learning Resources in the UI Leftnav.
  • Modernized the Teams Table in the UI.

🐛 Bug Fixes

  • Fixed auto-recovery of shared aiohttp session when it was closed.
  • Ensured model-level guardrails execute for non-streaming post_call in the proxy.
  • Prevented duplicate callback logs for pass-through endpoint failures.
  • Fixed Langfuse otel traceparent propagation.
  • Resolved Guardrail Mode Type Crash on Non-String Values in UI Logs.
  • Added Missing Permission Options in UI - Default Team Settings.
  • Fixed /key/block and /key/unblock endpoints to return 404 (instead of 401) for non-existent keys.
  • Fixed Key Update Endpoint returning 401 instead of 404 for nonexistent keys.
  • Surfaced Anthropic code execution results as code_interpreter_call in Responses API.
  • Fixed thinking blocks being dropped when the thinking field is null.
  • Preserved router model_group in generic API logs.
  • Fixed proxy only failure call type.
  • Populated usage_metadata in outputs for the Cost column in Langsmith integration.
  • Improved performance for model repetition detection.
  • Fixed logging for response incomplete streaming and custom pricing on /v1/messages and /v1/responses.
  • Fixed AntD Messages Not Rendering in UI.
  • Added team_member_budget_duration to NewTeamRequest in the proxy.
  • Fixed mock for get_auth_header instead of get_api_key in anthropic file content test.

Affected Symbols

/v2/team/list/key/block/key/unblockcode_interpreter_callANTHROPIC_AUTH_TOKENANTHROPIC_BASE_URLNewTeamRequest