Change8

b9651

📦 llama-cppView on GitHub →
1 features

Summary

This release introduces an optimization for SYCL backend by utilizing the native subgroup size for K-quant DMMV. It also provides numerous pre-compiled binaries across various operating systems and hardware configurations.

✨ New Features

  • SYCL backend now uses native subgroup size for K-quant DMMV operations.