b10653
📦 llama-cppView on GitHub →
✨ 2 features🔧 3 symbols
Summary
Introduced lazy tensor reading capabilities with the new TENSOR_READ_LAZY constant and a corresponding command-line flag. This release also includes updated pre-compiled binaries for various platforms and configurations.
Migration Steps
- The constant TENSOR_GET_ROW_LAZY has been renamed to TENSOR_READ_LAZY.
✨ New Features
- Added TENSOR_READ_LAZY to model_loader for lazy tensor reading.
- Introduced a --tensor-read-lazy command-line argument.