fast_generate
Found in 1 package: unsloth
unsloth(2 releases)
v0.1.48-betaThis release significantly enhances Unsloth Studio with new export formats (NVFP4, FP8, imatrix GGUF) and introduces an OpenAI-compatible API serving system with automatic model swapping. Core improvements include substantial speedups for GRPO and MoE training, alongside numerous reliability fixes across installation, RAG, and training workflows.
v0.1.405-betaBreakingThis release brings significant performance gains, up to 2x faster GGUF inference via MTP speculative decoding, and introduces extensive API provider support with built-in tools like web search and code execution. Security has been heavily hardened across the Studio platform, alongside numerous training and installer reliability fixes.
Track Symbol Changes
Use the Change8 MCP server or GitHub Action to get notified when fast_generate changes.
Learn More