Change8
Error2 reports

Fix APIConnectionError

in LiteLLM

Solution

APIConnectionError usually arises from network issues or temporary unavailability of the hosted LLM endpoint. Fix this by implementing retry mechanisms with exponential backoff and failover logic to redundant deployments within litellm, ensuring robust error handling for temporary API outages. Specifically, add `num_retries` kwargs to embedding model groups to trigger automatic retries and properly handle `APIConnectionError` in cooldown handlers to allow failover to healthy deployments.

Timeline

First reported:May 7, 2026
Last reported:May 7, 2026

Need More Help?

View the full changelog and migration guides for LiteLLM

View LiteLLM Changelog
Fix APIConnectionError in LiteLLM | Change8