Bedrock

This release introduces enhanced Docker image signature verification using cosign and includes significant improvements in Rust integration for Anthropic messages and Bedrock audio transcription. It also features various bug fixes and performance optimizations across the platform.

This release introduces enhanced Docker image signature verification using cosign and includes numerous bug fixes and new features across various components like proxy, guardrails, and UI. It also updates dependency constraints for Python and ddtrace.

This release introduces Docker image signature verification using cosign for enhanced security and adds features like declarative fallbacks and AES-256-GCM encryption for proxy credentials. Numerous bug fixes address issues across realtime processing, proxy permissions, Databricks tool calls, and UI stability.

This release introduces Docker image signing via cosign for enhanced security and adds numerous fixes across providers like Gemini, Vertex AI, and Bedrock. Key features include new model cost maps, UI improvements, and support for the Microsoft Purview DLP guardrail.

This release introduces Docker image signature verification via cosign and adds several new features, including support for gpt-image-2 and AIHubMix provider. Numerous bug fixes address issues related to caching, logging, Vertex AI, and proxy stability.

This release focuses heavily on security by introducing Docker image signing verification via cosign and includes numerous fixes across various providers (Anthropic, Azure, Gemini, Bedrock) and proxy features, alongside new model support like GPT-5.5.

This release introduces Docker image signing via cosign for enhanced security and adds support for new models like GPT-5.5/5.4 snapshots and Bedrock GLM-5. Numerous fixes address streaming issues, model pricing accuracy, and security hardening across proxy and authentication layers.

This release introduces Docker image signature verification via cosign and adds features like Dashscope image generation support and multi-region Vertex hosts. Numerous bug fixes address issues across providers, UI filtering, and budget tracking.

This release introduces Docker image signing verification instructions and includes numerous bug fixes across proxy, S3, logging, and guardrails. It also features a breaking change reducing the default Prometheus latency histogram buckets.

This patch release focuses heavily on bug fixes across various integrations (Anthropic, Azure, HuggingFace) and infrastructure stability, alongside introducing a new User Info V2 Endpoint and allowing organization_id setting on key updates.

This release focuses heavily on bug fixes, infrastructure improvements, and significant updates to the UI, including new endpoints and administrative features. Key fixes address security vulnerabilities, proxy stability, and various provider integrations.

This release introduces several new UI features, including user info endpoints and team management tools, alongside numerous bug fixes addressing issues in proxy stability, cost tracking, and API integrations. Dependency updates for security were also performed.

This release focuses heavily on stability, bug fixes across various providers (including Bedrock, Cohere, Vertex AI), and significant improvements to the LiteLLM UI and OAuth2 support. New features include Websearch interception and support for Sarvam AI and Perplexity Research API.

This release introduces several new provider integrations, enhanced Prometheus metrics for monitoring, and numerous bug fixes across proxying, routing, and provider configurations. Performance improvements were also made to provider configuration lookups.

This release introduces significant feature enhancements, including support for Lasso API v3, OpenTelemetry context propagation, and various UI improvements. Numerous bug fixes address issues across Azure OpenAI, logging, guardrails, and provider integrations.

This release introduces significant feature enhancements, including support for Lasso API v3, OpenTelemetry context propagation, and various UI improvements for credential and guardrail management. Numerous bug fixes address issues across Azure OpenAI, logging, and provider configurations.

This release introduces significant enhancements across observability (OpenTelemetry), guardrails, and the UI, alongside numerous bug fixes for providers like Azure OpenAI and improved performance.

This release focuses heavily on bug fixes across various providers, including Anthropic, OpenAI Realtime API, and Gemini, alongside introducing new Azure AVA TTS and cost tracking features.

This release introduces significant feature additions, including new provider support (OVHCloud, CompactifAI, Sambarova models), enhanced guardrail capabilities (tool-permission guardrail, Bedrock Guardrails), and major performance optimizations. Numerous bug fixes address issues across Bedrock, Cohere, Vertex AI, and proxy configurations.

This release introduces significant feature enhancements, including VLLM transcription support, Ollama chat improvements, and new provider integrations like OVHCloud and CompactifAI. Numerous bug fixes address issues across budget tracking, tool calls, and provider configurations.

This release introduces new features like Nvidia NIM tools support, an option to force proxy usage, and support for Novita AI and Claude 3.7 EU profile, alongside numerous bug fixes for Ollama, AWS Bedrock, and Azure DALL-E 3. Key changes include moving LLM Guard and Secret Detection to the Enterprise package.

This release introduces new model routing for Bedrock, adds support for an Azure prediction parameter, and fixes an issue with optional parameter handling in Vertex AI.

This release introduces a new deploy validation CLI and improves LLM initialization ergonomics, alongside several critical security and stability fixes.

This release introduces Bedrock LLM integration and enhances OpenAICompletion parameters while improving event bus thread safety. It also includes several bug fixes related to JWT decoding, input availability, and task handling.

This release focuses on standardizing provider factory methods and exception handling, while adding Bedrock document support and fixing critical bugs in GenAI, OpenAI, and Cohere integrations.

This release introduces image support for Bedrock, improves type safety with a py.typed marker, and includes critical fixes for Gemini streaming and Anthropic tool blocks.

This release introduces enhanced retry tracking, per-call hooks, and xAI streaming support while fixing critical bugs in OpenAI JSON mode and Gemini response handling. It also marks the transition from validation_context to a unified context parameter.

This release introduces native caching (Redis/AutoCache), expands provider support to include DeepSeek and Anthropic parallel tools, and migrates Google integrations to the new google-genai SDK.