b9886
📦 llama-cppView on GitHub →
✨ 1 features🔧 1 symbols
Summary
This release introduces an optimization to the ggml-cpu backend by utilizing the UE4M3 LUT for ARM NVFP4 dot products and provides numerous pre-compiled binaries for various operating systems and hardware configurations.
✨ New Features
- ggml-cpu: Use UE4M3 LUT in ARM NVFP4 dot product.