v0.1.501-beta
📦 unslothView on GitHub →
✨ 22 features🐛 30 fixes🔧 10 symbols
Summary
This release introduces local LLM training and inference for AMD GPUs, offering significant speed and VRAM improvements. It also includes enhanced features for web search, agent reliability, and Studio personalization.
Migration Steps
- To enable the opt-in MCP control plane, set UNSLOTH_STUDIO_ENABLE_MCP=1 and UNSLOTH_STUDIO_MCP_TOKEN.
- To update Unsloth on macOS, Linux, or WSL, run: curl -fsSL https://unsloth.ai/install.sh | sh
- To update Unsloth on Windows, run: irm https://unsloth.ai/install.ps1 | iex
✨ New Features
- Local LLM training and inference on AMD GPUs across Windows, WSL, and Linux.
- Support for RDNA2 and Gorgon Halo GPUs.
- Optimized ROCm builds supporting GGUF & Safetensors inference.
- Preliminary support for voice dictation / whisper.cpp for fast text to speech.
- Unified memory safetensors loading is 2x faster.
- Gradient checkpointing is much faster for unified memory devices.
- Automatic GPU placement and manual GPU/layer selection for running larger models.
- Ability to move MoE expert layers into system memory.
- Splitting models across multiple GPUs or using Tensor Parallelism.
- Saving hardware settings separately for each model and quant.
- Resume long chats without rebuilding the full conversation after an idle model frees its VRAM.
- Stalled Hugging Face XET downloads automatically retry over standard HTTP.
- Existing GGUF files are reused instead of being downloaded again when a model loads.
- Web search can now read PDF papers, manuals, and other PDF results.
- Parallel tool calls, reasoning output, and tool retries work more reliably.
- Opt-in MCP endpoint for compatible AI clients to inspect models, training history, start/stop training, load checkpoints, validate recipes, and export GGUFs.
- Dynamic NVFP4 models (keeps accuracy-sensitive layers in FP8 or BF16 while running the rest in W4A4) for faster inference and longer context on NVIDIA Blackwell GPUs.
- Personalization options for Studio: Standard, Classic, and Minimal color palettes (light/dark modes), custom colors, font import, font size adjustment, contrast, reduced motion.
- Voice settings tab in Studio for dictation, custom dictionary settings, and read-aloud.
- Unsloth Studio available in French, German, Spanish, Hindi, Arabic, Russian, and Korean.
- Four-level tool-call permission selector for agents: Ask, Approve for me, Off, and Full access.
- Agent workspace isolation and safer installer checks.
🐛 Bug Fixes
- Fixed AMD installing not detecting GPUs on Strix Halo / other AMD GPUs.
- Improved RDNA4, HIP / ROCm failure auto fixing and catching.
- Fixed rollback environments during installs eating 5GB of disk space (now auto cleans).
- Text-only training with multimodal models no longer truncates long examples before packing.
- Fine-tuned Qwen3.5 and Qwen3.6 MTP models now export correctly to GGUF.
- Fixed a Windows permission error that could stop GGUF exports during the final write step.
- Smart_chunk_text single-chunk path leaks internal tensor type when eos_token_id is None.
- Fixed Settings layout overflow.
- Kept nested dropdown menus on screen.
- Fixed DeepSeek reasoning test shim.
- Harden desktop release token permissions.
- Studio: clickable sidebar settings cog, long name truncation, Canvas menu opt-in.
- CI: opt tool-calling smoke tests out of the chat tool approval gate.
- Fixed Inkling reasoning-effort coercion for duck-typed engine stand-ins.
- Fixed config cards clipping content at narrow window widths.
- Studio: use one shared Hugging Face token across Settings and training.
- Studio: don't drop parallel tool calls after an internal no-op.
- Studio: extract text from PDF web results.
- Don't kill live llama-servers when a new Studio instance starts.
- Fix unsloth_push_to_hub_gguf(save_method="lora") raises NameError.
- Fix stalled Hub downloads over HTTP.
- Relax Metal context-store timeout by default.
- Studio: don't re-download updated GGUFs on load.
- Fix Studio reasoning channel rendering.
- Fix Studio safetensors tool reprompt reasoning leakage.
- Studio: don't apply nest_asyncio on plain CLI starts (breaks asyncio on Python 3.14+).
- Propagate fp8 block_size before the early return in get_lora_parameters_bias.
- Fix tokenizer.model check after saving it, not before.
- Stabilize Studio regression tests.
- Skip .jsonl lines that are invalid.