mul_mat_id
Found in 1 package: llama-cpp
llama-cpp(9 releases)
b10205This release introduces a group matmul direct API for mul_mat_id in ggml-zendnn and scales the MUL_MAT_ID fallback threshold by expert count. It also provides numerous pre-compiled binaries for various platforms and hardware configurations.
b9951BreakingIntroduces the initial ET backend for ggml, significantly expanding the supported operations and optimizations. This release includes numerous bug fixes, performance enhancements, and new features for various kernels and backends.
b9817This release updates the OpenVINO backend to version 2026.2.1, introduces self-contained release packages, and includes several operator improvements for the OpenVINO backend.
b8785This release introduces NVFP4 support within the Vulkan backend for several core tensor operations. It also provides a comprehensive set of pre-compiled binaries for diverse operating systems and hardware accelerators.
b8557This release introduces significant enhancements to the Hexagon backend by adding support for IQ4_NL and MXFP4 quantization types, alongside fixes for mixed-quant models and code formatting.
b7632This release focuses on bug fixes, primarily addressing issues within the Vulkan backend related to quantization overflow and matrix multiplication failures across different hardware configurations.
b7549This release optimizes Vulkan performance by preprocessing expert IDs to more efficiently manage workgroups. It also provides updated binaries for a wide range of operating systems and hardware backends including CUDA 12/13, SYCL, and HIP.
b7548This release focuses on performance optimizations for the Vulkan backend, specifically targeting the coopmat2 mul_mat_id shader by improving memory access patterns and reducing overhead.
b7547This release optimizes the Vulkan backend by adjusting the block size (BK=32) for cooperative matrix multiplication. It includes a wide range of pre-built binaries for multiple architectures and acceleration backends.
Track Symbol Changes
Use the Change8 MCP server or GitHub Action to get notified when mul_mat_id changes.
Learn More