Change8

litellm_idx-db-dev-v1.81.14

📦 litellmView on GitHub →
13 features🐛 39 fixes🔧 12 symbols

Summary

This release focuses heavily on UI enhancements, introducing new guardrail features, performance optimizations across streaming and cost calculation, and significant stability fixes for proxy connections and testing infrastructure.

Migration Steps

  1. If you rely on duplicate issue detection based on title text, note that it is now AI-powered.
  2. If you were using the old Zapier webhook for feedback, update to use the feedback.litellm.ai endpoint.

✨ New Features

  • Upgraded duplicate issue detection to be AI-powered instead of relying solely on title text.
  • Added retry count display for requests in UI Logs.
  • Injected Credential Name as a Tag for Usage Page Filtering.
  • Routed GitHub actions through LiteLLM.
  • Added topic blocker guardrail with keyword and embedding implementations.
  • Added insults content filter and topic blocking compliance UI.
  • Introduced Guardrail Garden (guardrail marketplace) in the UI.
  • Added OpenRouter/minimax/minimax-m2.5 pricing.
  • Added proxy URL display in ModelHub.
  • Added support for configurable vector dimensions in semantic-cache.
  • Added session_id for better routing.
  • Added custom favicon support for the proxy.
  • Added forward_client_headers_to_llm_api toggle to general settings in UI.

🐛 Bug Fixes

  • Replaced Zapier webhook with the feedback.litellm.ai endpoint.
  • Fixed cost calculation in UI Spend Logs.
  • /get_image endpoint was ignoring UI_LOGO_PATH when cached_logo.jpg existed.
  • Improved performance for the Aggregated Daily Activity Endpoint.
  • Fixed UI Logs table not updating and pagination issues.
  • Eliminated per-chunk thread spawning in the async streaming path.
  • Improved Redis connection pool reliability.
  • Fixed self-healing of Prisma connection for auth and runtime in the proxy.
  • Fixed various UI issues.
  • Suppressed warning for litellm-dashboard team in agent permission handler.
  • Fixed input_cost_per_token being masked in the UI for Model Info.
  • Updated UI for Organization Info to show member email, use AntD tabs, and a reusable MemberTable.
  • Corrected modelInput format for Bedrock Converse API batch models.
  • Fixed tagging only the selected deployment in access group creation.
  • Prevented double UUID in S3 key for create_file in Bedrock.
  • Resolved credentials for UI-created models in batch file uploads.
  • Recovered from prisma-query-engine zombie process in the proxy.
  • Fixed Ruff PLR0915 lint errors.
  • Resolved flaky test failures in health, spend logs, and CLI tests.
  • Resolved 7 mypy linting errors on main.
  • Updated Claude model name in a specific test.
  • Skipped 'projects' field in a team update test assertion.
  • Updated gcs pubsub v1 fixture with new SpendLogsMetadata fields in tests.
  • Fixed tests to read CI_CD_DEFAULT_ANTHROPIC_MODEL env var instead of hardcoding the model.
  • Fixed security vulnerabilities (CVE-2025-69873 and CVE-2026-26996) in documentation dependencies.
  • Added missing Set and Dict imports (F821) for Ruff.
  • Normalized camelCase thinking parameter keys to snake_case.
  • Fixed security vulnerabilities and allowedlist nodejs_wheel CVEs in Grype scan.
  • Isolated flaky files endpoint tests from global proxy state.
  • Isolated flaky tests by restoring global state in setup/teardown.
  • Fixed 6 failing UI unit tests.
  • Mocked httpx in RPM limit pass-through tests.
  • Added flaky retries to flaky CI tests.
  • Restored broad is_database_connection_error and added is_database_transport_error for reconnect in proxy.
  • Fixed 2 failing CI tests in litellm_mapped_tests_proxy_part2.
  • Optimized skipping duplicate get_standard_logging_object_payload for non-streaming requests.
  • Reused LiteLLM_Params for performance.
  • Optimized completion_cost().
  • Added ensure_project_id migration and bumped litellm-proxy-extras to 0.4.46.

Affected Symbols