b9913
📦 llama-cppView on GitHub →
✨ 1 features
Summary
This release introduces Q2_0 quantization support for the CPU backend. It also provides a comprehensive set of pre-compiled binaries for numerous operating systems and hardware configurations.
✨ New Features
- Added Q2_0 quantization type definition and CPU backend support.