v4.51.3-BitNet-preview
📦 transformersView on GitHub →
✨ 2 features🔧 3 symbols
Summary
This preview release introduces the BitNet model architecture to the transformers library, enabling high-performance 1-bit LLM inference.
Migration Steps
- Install the preview version using: pip install git+https://github.com/huggingface/transformers@v4.51.3-BitNet-preview
✨ New Features
- Added support for BitNet, a native 1-bit Large Language Model architecture.
- BitNet models offer improved computational efficiency in terms of memory, energy, and latency while maintaining performance comparable to full-precision models.