●Change8

v1.88.0-rc.1

📦 litellmView on GitHub →
✨ 8 features🐛 22 fixes🔧 17 symbols

Summary

This release introduces Docker image signature verification via cosign and adds significant features for OpenTelemetry instrumentation, MCP routing, and enterprise context management. Numerous bug fixes address issues across Bedrock, Anthropic, guardrails, and proxy authentication flows.

Migration Steps

  1. If using the Docker image, verify signatures using the pinned commit hash or release tag as detailed in the release notes, utilizing the provided cosign commands.

✨ New Features

  • Added support for stateless and stateful clients via session-id routing in MCP.
  • Implemented well-known agent-card discovery and LangGraph Platform mode for A2A.
  • Introduced typed semconv-aligned OpenTelemetry instrumentation.
  • Added team_metadata, http.route, and model names to OpenTelemetry inference spans.
  • Added compact_20260112 polyfill for non-Anthropic providers for context management.
  • Added RESEND_FROM_EMAIL configuration for self-hosted Resend sends in enterprise setups.
  • Extended passthrough_managed_object_ids capability to Azure.
  • Implemented additive key access-group grants and opt-in member assignment for MCP/Auth.

🐛 Bug Fixes

  • Restored real Bedrock batch S3 bucket/role in oai_misc_config for CI.
  • Persisted disable_global_guardrails setting on keys.
  • Exposed keys_count on /v2/team/list endpoint and wired UI Resources badge.
  • Stopped injecting unsupported output_config.effort=xhigh for Claude Code on Sonnet/Opus 4.6.
  • Resolved key.access_group_ids mapping for MCP servers (ungated).
  • Enforced deployment budgets for dynamically added models in the router.
  • Mapped stripped batch body.model to proxy alias for authentication.
  • Fixed support for tool search results and chat annotations on Bedrock.
  • Ignored stale IDs when saving keys in MCP.
  • Fixed duplicate Claude code traces.
  • Preserved source_url in GET /v1/mcp/server list responses.
  • Preserved omitted fields on PUT /v1/mcp/server partial updates.
  • Fixed CI to make litellm_internal_staging green (logging test + Bedrock Opus 4.7 self-heal).
  • Normalized Bearer prefix in the safe-hash helper for proxy/auth.
  • Returned HTTP 400 for litellm content filter blocks.
  • Restricted vector store index create/delete operations to proxy admins.
  • Enforced allowed_passthrough_routes for auth=true pass-through.
  • Stopped pre-zeroing counter and now only writes {spend, budget_reset_at} during budget reset.
  • Fixed OpenAI moderation streaming flags being wired through to the unified dispatcher.
  • Capped no-max_tokens TPM floor at the smallest configured limit in the v3 limiter.
  • Tolerated trailing slash in SERVER_ROOT_PATH login redirect.
  • Fixed logout redirect loop across development and proxy origins in the UI.

Affected Symbols

oai_misc_config/v2/team/listkey.access_group_idsdeployment budgetsbatch body.modeltool search resultschat annotationsGET /v1/mcp/serverPUT /v1/mcp/serverlitellm content filtervector store index create/deleteallowed_passthrough_routesbudget reset logicopenai-moderationv3 limiterSERVER_ROOT_PATH login redirectlogout redirect logic