b9936
📦 llama-cppView on GitHub →
🐛 1 fixes
Summary
This release includes a fix for prompt batch splitting in the server component to respect the minimum step size. It also provides numerous pre-compiled binaries for various operating systems and hardware configurations.
🐛 Bug Fixes
- Server now respects min-step when splitting prompt batches.