b9895
📦 llama-cppView on GitHub →
🐛 2 fixes🔧 1 symbols
Summary
This release addresses critical bugs in speculative decoding, specifically fixing an out-of-bounds read and cleanup issues in the ngram-map when prompts are shrunk. It also provides updated pre-built binaries for numerous operating systems and hardware targets.
🐛 Bug Fixes
- Fixed an out-of-bounds read in ngram-map when the prompt is shrunk.
- Fixed ngram-map cleanup cutoff after prompt shrink.