b8475
📦 llama-cppView on GitHub →
✨ 1 features🔧 1 symbols
Summary
This release introduces the ability for the server router to report the sleep status of child instances, alongside internal refactoring and nit fixes. It also provides updated binaries for macOS, Linux, Windows, and openEuler.
✨ New Features
- The server component now allows the router to report the sleep status of its child instances.