b9272
📦 llama-cppView on GitHub →
✨ 4 features🔧 1 symbols
Summary
This release introduces several new application features including batched benchmarking, parameter fitting, quantization, and perplexity calculation. It also provides a comprehensive set of pre-compiled binaries for macOS, Linux, Android, Windows, and openEuler across various CPU/GPU backends.
✨ New Features
- Added 'batched-bench' functionality to the application.
- Added 'fit-params' functionality to the application.
- Added 'quantize' functionality to the application.
- Added 'perplexity' calculation functionality to the application.