b10541
📦 llama-cppView on GitHub →
✨ 4 features🐛 1 fixes🔧 1 symbols
Summary
This release introduces a new --mmproj-device argument and a corresponding environment variable for controlling the mmproj device backend, along with immediate loading of the backend and a shortflag option.
✨ New Features
- Add --mmproj-device argument for specifying the mmproj device.
- Introduce MTMD_BACKEND_DEVICE environment variable for backwards compatibility with mmproj device.
- Load mmproj device backend immediately.
- Add -mmdev shortflag for the --mmproj-device argument.
🐛 Bug Fixes
- Correctly handle mmproj device name as a pointer.