b8807
📦 llama-cppView on GitHub →
✨ 4 features🔧 1 symbols
Summary
This release focuses on performance improvements for the Vulkan backend, specifically optimizing the im2col operation and tuning device handling. Numerous pre-compiled binaries are also provided.
✨ New Features
- Vulkan backend optimization for im2col operation.
- Vulkan backend now caps workgroups.
- Minimal device tuning applied to Vulkan backend.
- Vulkan backend now uses vendor_id instead of subgroup size for device tuning.