Migrating to BitsAndBytes 0.48.0
Version 0.48.0 introduces 2 breaking changes. This guide details how to update your code.
Released: 9/30/2025
2
Breaking Changes
3
Migration Steps
3
Affected Symbols
⚠️ Check Your Code
If you use any of these symbols, you need to read this guide:
Maxwell GPU support (sm50)PyTorch 2.2Linear8bitLtBreaking Changes
●Issue #1
Support for PyTorch 2.2 has been dropped; the new minimum requirement is PyTorch 2.3.0.
●Issue #2
Maxwell GPU support (sm50) has been removed from all CUDA builds.
Migration Steps
- 1If you rely on Maxwell GPUs (sm50), you must migrate to newer NVIDIA hardware as support has been dropped.
- 2For Intel GPU usage, ensure you have PyTorch 2.6.0 or newer with XPU support.
- 3For Intel Gaudi usage, ensure you have Gaudi v1.21 and PyTorch 2.6.0 or newer.
Release Summary
This release introduces official support for Intel GPUs and Intel Gaudi accelerators, alongside significant performance improvements for CUDA 4bit dequantization kernels and compatibility updates for PyTorch and CUDA versions. Support for PyTorch 2.2 and Maxwell GPUs has been dropped.
Need More Details?
View the full release notes and all changes for BitsAndBytes 0.48.0.
View Full Changelog