Fix ConnectionResetError

✅ Solution

ConnectionResetError in tgi often arises when the server unexpectedly closes a connection while the client is still attempting to send or receive data, frequently due to timeouts or exceeding server limits. Implement keep-alive mechanisms on both client and server sides to maintain persistent connections, and adjust timeout settings within the tgi configuration (e.g., --max-concurrent-requests, --max-input-length) to accommodate the expected workload. Also, check for resource exhaustion on the server.