b8153
📦 llama-cppView on GitHub →
✨ 1 features
Summary
The server component now supports multi-modal prompt caching. This release also provides extensive pre-compiled binaries for a wide range of operating systems and hardware configurations.
✨ New Features
- Enabled multi-modal prompt caching on the server side.