T5

This release introduces several new models including Meta Muse Glimmer, GraniteMoeSWA, A.X-K1/K2, and Cosmos3 Edge. It also includes significant updates to attention mechanisms, vision processing, and generation capabilities, alongside important breaking changes in kernel opt-in and cache cropping.

Version 5.8.0 introduces support for several new models including DeepSeek V4, Gemma 4 Assistant, and various vision/speech models. This release also removes Apex integration, requiring migration to native PyTorch equivalents for related functionality.