hex-bufs
Found in 1 package: llama-cpp
llama-cpp(3 releases)
b10643BreakingThis release introduces significant enhancements to the Hexagon backend, including multi-NPU device support, a fully asynchronous backend, and improved performance for various operations like ALLREDUCE and matrix multiplications. It also includes numerous bug fixes and optimizations across different Hexagon modules.
b10052This release introduces a significant rework of the L2 cache handling in the hexagon backend, focusing on dirty bit tracking and lazy flushing for improved performance. It also includes numerous updates and fixes across various hexagon and HMX components, enhancing thread management, DMA operations, and overall robustness.
b8754This release significantly improves hexagon performance through op request batching, buffer management rewrite, and explicit L2 cache control. It also removes the deprecated GGML_HEXAGON_EXPERIMENTAL environment variable.
Track Symbol Changes
Use the Change8 MCP server or GitHub Action to get notified when hex-bufs changes.
Learn More