b8231
📦 llama-cppView on GitHub →
✨ 1 features🐛 2 fixes
Summary
This release introduces true streaming capabilities to the Autoparser by relaxing atomicity constraints and includes various pre-compiled binaries for broad platform and hardware support.
✨ New Features
- Enabled True Streaming parsing in Autoparser by relaxing atomicity constraints.
🐛 Bug Fixes
- Removed redundant atomics related to Autoparser.
- Addressed whitespace issues in Autoparser.