Change8

v1.81.14.dev.1

📦 litellmView on GitHub →
4 features🐛 17 fixes🔧 8 symbols

Summary

This release focuses heavily on bug fixes across the proxy, UI, and logging systems, alongside infrastructure updates like code formatting and dependency regeneration. New features include enhanced team endpoint access control and improved Anthropic environment variable support.

Migration Steps

  1. Ensure Anthropic credentials are set via ANTHROPIC_AUTH_TOKEN and ANTHROPIC_BASE_URL environment variables if using Anthropic provider.
  2. If relying on proxy --api_version default, be aware it now defaults to AZURE_DEFAULT_API_VERSION.

✨ New Features

  • Added org admin access control, members_count, and indexes to the /v2/team/list endpoint.
  • Added external link icon to Learning Resources in the UI Leftnav.
  • Support ANTHROPIC_AUTH_TOKEN and ANTHROPIC_BASE_URL environment variables for Anthropic provider.
  • Use AZURE_DEFAULT_API_VERSION as the default for proxy --api_version.

🐛 Bug Fixes

  • Fixed auto-recovery of shared aiohttp session when it was closed.
  • Fixed model-level guardrails not executing for non-streaming post_call in the proxy.
  • Prevented duplicate callback logs for pass-through endpoint failures.
  • Fixed Langfuse otel traceparent propagation.
  • Fixed Guardrail Mode Type Crash on Non-String Values in UI Logs.
  • Fixed missing permission options in UI - Default Team Settings.
  • Fixed /key/block and /key/unblock endpoints returning 401 instead of 404 for non-existent keys.
  • Fixed Key Update Endpoint returning 401 instead of 404 for Nonexistent Keys.
  • Surfaced Anthropic code execution results as code_interpreter_call in Responses API.
  • Fixed thinking blocks being dropped when the thinking field is null.
  • Preserved router model_group in generic API logs.
  • Fixed proxy only failure call type.
  • Populated usage_metadata in outputs for the Cost column in Langsmith integration.
  • Fixed model repetition detection performance.
  • Fixed logging for response incomplete streaming and custom pricing on /v1/messages and /v1/responses.
  • Added team_member_budget_duration to NewTeamRequest in the proxy.
  • Added missing team_member_budget_duration parameter documentation to new_team docstring.

Affected Symbols