LLMRouter

This release introduces significant enhancements to Ray Serve LLM with KV cache and token-aware routing, and Ray Core with task event offloading. It also brings Databricks DeltaLake integration and a new shuffle v2 backend to Ray Data, alongside experimental Ray Sandbox and expanded TPU support across Ray Train and Core.

Ray 2.43 adds alpha LLM support in Ray Data and Serve, introduces experimental Ray Train V2, and brings uv run integration along with numerous enhancements and bug fixes.