BatchIterator

This release introduces significant enhancements to Ray Serve LLM with KV cache and token-aware routing, and Ray Core with task event offloading. It also brings Databricks DeltaLake integration and a new shuffle v2 backend to Ray Data, alongside experimental Ray Sandbox and expanded TPU support across Ray Train and Core.