b9190
📦 llama-cppView on GitHub →
✨ 1 features🔧 1 symbols
Summary
This release includes an internal change in the server router to allocate temporary buffers on the heap. It also provides extensive pre-compiled binaries for macOS, Linux, Android, Windows, and openEuler platforms supporting various CPU/GPU backends.
✨ New Features
- Allocated temporary buffer on the heap within the server router component.