b9028
📦 llama-cppView on GitHub →
✨ 1 features🔧 1 symbols
Summary
This release introduces a new feature to save memory in device buffers for llama operations and extends related save/load state tests.
✨ New Features
- Added an option to save memory in device buffers for llama operations.