●Change8

v1.79.1.dev3

📦 litellmView on GitHub →
✨ 10 features🐛 12 fixes🔧 12 symbols

Summary

This release introduces significant feature enhancements, including Milvus vector store support and Azure AI Vector Store improvements, alongside numerous bug fixes across various integrations and the UI.

Migration Steps

  1. If you are using Pydantic v2.11+, ensure your environment is updated to resolve potential memory accumulation issues related to deprecation warnings.

✨ New Features

  • Milvus vector store search support added.
  • Azure AI Vector Stores now support "virtual" indexes and vector store creation via the passthrough API.
  • Added support for `custom_llm_provider` for non-generation video endpoints.
  • LLM provider response headers are now added to the Responses API.
  • E2E Container API Support added.
  • Guardrail information structure changed to use a list type for `guardrail_information`.
  • Milvus Passthrough API now supports create and read vector store operations.
  • UI: Added functionality to delete Team Members with friction/confirmation.
  • UI: Improved Model Existing Credentials management.
  • UI: Guardrail Info Page now displays PII Configuration.

🐛 Bug Fixes

  • Resolved memory accumulation issue caused by Pydantic 2.11+ deprecation warnings.
  • Fixed empty assistant message handling in AWS Bedrock Converse API to prevent 400 Bad Request errors.
  • Fixed issue where Azure did not accept extra body parameters.
  • Fixed regression in UI where Guardrail Entity could not be selected and was not displayed.
  • Fixed Anthropic token counting when using VertexAI.
  • Stripped base64 content in S3 operations.
  • Fixed dot notation support for UI SSO configuration.
  • Enabled support for responses API streaming in langfuse otel.
  • Fixed returning the diarized transcript when required in the request.
  • Fixed index field not being populated correctly in streaming mode when n>1 and tool calls are present.
  • Updated perplexity cost tracking.
  • Fixed `image_config.aspect_ratio` not working for `gemini-2.5-flash-image`.

🔧 Affected Symbols

Passthrough EndpointsAWS Bedrock Converse APIAzureGuardrail EntityAnthropic token countingVertexAIs3ui_sso.pylangfuse otelguardrail_informationimage_config.aspect_ratiogemini-2.5-flash-image