b9747
📦 llama-cppView on GitHub →
✨ 1 features🐛 1 fixes🔧 1 symbols
Summary
This release introduces real-time model load progress tracking via a new SSE endpoint on the server and includes an internal fix involving a mutex for router notifications.
✨ New Features
- Implemented real-time model load progress tracking via the /models/sse endpoint in the server component.
🐛 Bug Fixes
- Added a mutex for notify_to_router functionality.