Symbol2 releases
hex-opbatch
Found in 1 package: llama-cpp
llama-cpp(2 releases)
b10643BreakingThis release introduces significant enhancements to the Hexagon backend, including multi-NPU device support, a fully asynchronous backend, and improved performance for various operations like ALLREDUCE and matrix multiplications. It also includes numerous bug fixes and optimizations across different Hexagon modules.
b8754This release significantly improves hexagon performance through op request batching, buffer management rewrite, and explicit L2 cache control. It also removes the deprecated GGML_HEXAGON_EXPERIMENTAL environment variable.
Track Symbol Changes
Use the Change8 MCP server or GitHub Action to get notified when hex-opbatch changes.
Learn More