gRPC

This release introduces significant performance optimizations for Kimi-K3 and DeepSeek V4, alongside advancements in speculative decoding and Model Runner V2 maturation. It also features a new Rust frontend and gRPC capabilities, tiered KV cache offloading, and expanded model support.

vLLM v0.27.0 introduces Kimi K3 support, new model additions like Qwen3.5 and VaultGemma, and a significant upgrade to PyTorch 2.13.0. The release also enhances performance and features across various areas including FlashAttention 4, Model Runner V2, KV offloading, and hardware enablement.

This release introduces significant improvements to Ray Data with DataSourceV2 enabled by default and Hash Shuffle V2. Ray Serve enhances its HAProxy ingress with a new PyPI package and gRPC support, while Ray Core adds an embedded RocksDB backend for GCS fault tolerance.

This release introduces significant performance and stability enhancements, including the TurboQuant quantization variant and improved memory management features. Several critical bugs related to indexing, recovery, and cluster operations have also been resolved.

This release introduces HFresh to GA alongside major features like the Secure MCP Server (Preview) and BlobHash property type. Significant work was also done on extensible tokenizers, backup reliability, and internal gRPC communication hardening.