Change8

v0.1.800-beta

Breaking Changes
📦 unslothView on GitHub →
2 breaking35 features🐛 25 fixes🔧 12 symbols

Summary

Unsloth now supports running Qwen3.8 models locally with reduced RAM requirements and offers significant performance improvements, including faster inference for GGUFs and MiniMax-H3. New features enhance chat capabilities, tool integration, and hardware compatibility.

⚠️ Breaking Changes

  • Windows installer: fix single-AMD-GPU detection and the unrecoverable "needs repair" loop. Previously, single-AMD-GPU hosts were incorrectly detected as having no GPU, leading to an infinite repair loop. This is now fixed.
  • Windows: fix single-AMD-GPU hosts reading as "gpu none" and looping the installer. Similar to the above, this resolves an issue where the installer would loop indefinitely on Windows systems with a single AMD GPU due to incorrect detection.

Migration Steps

  1. Update install scripts (install.sh / install.ps1) to use unsloth>=2026.8.15.

✨ New Features

  • Qwen3.8-27B and Qwen3.8-2.4T can now be run locally in Unsloth, including fine-tuning Qwen3.8-27B.
  • Run on 17GB RAM via Unsloth Dynamic GGUFs.
  • NVFP4 quants uploaded for Qwen3.8-27B.
  • Extra llama-server arguments allowed with a custom VRAM toggle.
  • External provider now supports tool calling, tool support, and login with Codex.
  • Fast FP8 10x faster MiniMax-H3 inference.
  • 10% faster inference for GGUFs.
  • Bypass permissions fixed for GGUFs.
  • Connected AI providers can use their own Search or Unsloth Desktop's built-in Search and tools, with tool results passed back to the model for multi-step tasks.
  • Sign in with a Codex subscription to use Codex tools inside Chat.
  • Chat shows live prompt and generation speeds, and long streaming replies use less CPU.
  • Chat settings persist across remote sessions.
  • Paste a YouTube link to attach its transcript (title, channel, duration, link, caption language).
  • Save full chats or replies into project sources, preserving reasoning, tool calls, and citations.
  • MiniMax-H3 can run on smaller supported GPUs by splitting large model parts.
  • Model picker hides H3 options that current hardware cannot run.
  • H3 options are labeled 'Fast FP8' or 'Slow' to indicate speed differences.
  • Inference is up to 10% faster with lower VRAM use and a tunable memory limit.
  • Idle image and video models can optionally unload to free VRAM for Chat or Training.
  • Added better support for AMD RDNA 3, RDNA 4, and Strix Halo systems.
  • VRAM checks no longer reserve extra GPU memory.
  • Multi-GPU ROCm device matching is safer.
  • Macs now choose context size from actually free memory.
  • RAG document indexing uses the CPU by default, freeing up GPU memory.
  • Model settings include an 'Extra Arguments' box for custom `llama-server` flags.
  • Unsloth checks custom `llama-server` flags against the installed build and saves valid ones per model.
  • Training checks for newer Transformers versions and prompts before installing.
  • Training preview indicates when a model must use 16-bit instead of 4-bit.
  • GGUF exports check disk space before starting a merge and provide clearer error messages.
  • On Kaggle, large saves can use the bigger temporary drive.
  • Settings > Debugging now shows main server and model-runner logs with live refresh modes.
  • Copy visible log or full path for bug reports, with sensitive information hidden in the viewer.
  • Cached RAG models load first to avoid stalls when Hugging Face is unreachable.
  • Slow installs can continue during large downloads and show progress.
  • Pinned models can be reordered by dragging in the model list.

🐛 Bug Fixes

  • Bypass permissions fixed for GGUFs.
  • Fixed GGUF image detection when choosing a model for the API.
  • Fixed LoRA being ignored by vLLM GRPO rollouts on newer TRL versions.
  • Fixed Hugging Face dataset links and linked folders on Windows.
  • Stop the PowerShell progress bar throttling installer downloads to 0.65 MB/s.
  • Studio: let repair proceed past a backend that is not ours.
  • Studio: keep the download rail in the corner under the welcome composer.
  • Studio: keep prose that documents call:NAME{...} in the answer.
  • Studio: name the checkpoint on MiniMax H3 quant chips.
  • Studio: ask macOS for zombie status with the flavor that answers.
  • Drop the inert capacity-sweeper dispatch from the desktop release.
  • Installer: suppress macOS uv developer tools dialog.
  • Read macOS zombie status from sysctl, the call that answers.
  • Studio: remove obsolete onboarding and model code.
  • Studio: stop building test scratch paths inside a macOS sensitive root.
  • Studio: keep the compiled cache when a sibling backend is live.
  • Drop socket reads that arrive after an h11 connection is closed.
  • Studio: name a connected model the provider dropped instead of its raw id.
  • Studio: classify a moved or mixed model folder from the checkpoint, not from directory order.
  • Route spoofed Strix Halo GPUs to the AMD per-gfx index.
  • Studio: report host VRAM usage when no single GPU's usage can be attributed.
  • Studio: stop the memory guards trusting an over-reported free VRAM on Windows ROCm.
  • Studio: give the tool-call strip one owner and one scan order.
  • Studio: stop rescanning the whole answer on every streamed token.
  • Studio: cut backend start time and stop blocking the event loop.

Affected Symbols