●Change8

v1.78.3-nightly

📦 litellm
✨ 13 features🐛 7 fixes🔧 2 symbols

Summary

This release introduces new features like global vendor discounts, UI discount settings, and support for Gemini 2.5 Flash and new models, alongside substantial performance improvements in the router and various bug fixes.

Migration Steps

  1. If using LiteLLM Proxy, consider updating your Docker image to `ghcr.io/berriai/litellm:main-v1.78.3-nightly` to incorporate performance improvements and new features.

✨ New Features

  • Added global vendor discount specification for cost tracking.
  • Enabled setting Provider Discounts via the UI.
  • Added Gemini 2.5 Flash Image (Nano Banana) support in GA.
  • Added support for JP Cross-Region Inference for jp.anthropic.claude-haiku-4-5-20251001.
  • Added support parameters to model_prices json.
  • Added new models to the lemonade provider.
  • Implemented prompt caching for Anthropic models using OpenRouter.
  • Updated Pillar Security integration to support no persistence mode in LiteLLM Proxy.
  • Added support for Dall-e-2 for Image Edits API.
  • Added support for calling /invoke and /converse routes through AI Gateway, including models on config.yaml.
  • Added SSO support for OKTA via PKCE in the UI.
  • Added guardrail for image generation.
  • Added support for responses mode in health check.

🐛 Bug Fixes

  • Improved CometAPI provider support, including embeddings, image generation, and docs.
  • Fixed Entraid app roles JWT claim cleaning.
  • Added type hint to function_to_dict and fixed a typo.
  • Fixed CI/CD issues related to missing env keys and Linter type errors.
  • Corrected configuration for claude opus.
  • Ensured guardrail memory syncs correctly after database updates.
  • Fixed issue where an object was not converted to the correct type.

🔧 Affected Symbols

function_to_dictmodel_prices