GDN

This release updates the OpenVINO backend to version 2026.3.1, adds support for Whisper.cpp and Qwen3.5 on NPU, and introduces new operations. It also includes significant improvements to static shape handling, token-count independence, and chunked prefill for better performance and accuracy.

This release introduces several new models including Meta Muse Glimmer, GraniteMoeSWA, A.X-K1/K2, and Cosmos3 Edge. It also includes significant updates to attention mechanisms, vision processing, and generation capabilities, alongside important breaking changes in kernel opt-in and cache cropping.

This release focuses heavily on DeepSeek V4 maturity with new kernel support and packaging, significant advancements in Model Runner V2, and the introduction of an experimental Rust frontend. Performance saw notable gains from batch-invariant inference with Cutlass FP8 and the rollout of multi-tier KV cache offloading.