Change8

b9551

📦 llama-cppView on GitHub →
🐛 1 fixes🔧 1 symbols

Summary

This release introduces an optimization to avoid unnecessary copies within the kv-cache mechanism. It also provides updated pre-compiled binaries for various operating systems and hardware configurations.

🐛 Bug Fixes

  • Avoided copies of kv cells in kv-cache operations.

Affected Symbols