Change8

b9531

📦 llama-cppView on GitHub →
1 features🐛 1 fixes

Summary

This release updates the tensor processing (TP) granularity to 128 and removes an internal assertion. It also provides numerous pre-compiled binaries for various operating systems and hardware configurations.

✨ New Features

  • Tensor processing (TP) granularity is now rounded up to 128.

🐛 Bug Fixes

  • Removed an unnecessary assertion.