b8559
📦 llama-cppView on GitHub →
🐛 3 fixes🔧 2 symbols
Summary
This release stabilizes the interaction between the lazy grammar sampler and the active reasoning budget by inhibiting sampling when reasoning is active. It also includes various bug fixes and provides updated binaries for numerous hardware and OS configurations.
🐛 Bug Fixes
- Inhibited the lazy grammar sampler when reasoning budget is active to prevent sampling during reasoning.
- Fixed typo in continuation logic.
- Fixed tests related to continuation logic.