●Change8

v1.80.9.dev1

📦 litellmView on GitHub →
✨ 5 features🔧 1 symbols

Summary

This release adds Helicone and SAP Gen AI providers, a new NVIDIA model, and a dynamic rate limiter with TTL support, along with documentation and minor routing updates.

✨ New Features

  • Add Helicone as a provider.
  • Add SAP Gen AI provider.
  • Add new model nvidia nim `llama-3.2-nv-rerankqa-1b-v2`.
  • Dynamic Rate Limiter now supports specifying TTL for in-memory cache.
  • Move query parameters to `create_pass_through_route` call in Langfuse passthrough.

🔧 Affected Symbols

create_pass_through_route