b10199
📦 llama-cppView on GitHub →
✨ 1 features🐛 1 fixes🔧 2 symbols
Summary
This release introduces support for `inp embd` in the server for next token generation and includes a fix for `server_batch()`.
✨ New Features
- Server now supports `inp embd` for generating the next token.
🐛 Bug Fixes
- Fixed an issue with `server_batch()`.