b10205
📦 llama-cppView on GitHub →
✨ 2 features🔧 2 symbols
Summary
This release introduces a group matmul direct API for mul_mat_id in ggml-zendnn and scales the MUL_MAT_ID fallback threshold by expert count. It also provides numerous pre-compiled binaries for various platforms and hardware configurations.
✨ New Features
- Introduced a group matmul direct API for mul_mat_id in ggml-zendnn.
- Scaled the MUL_MAT_ID fallback threshold by expert count in ggml-zendnn.