b9718
📦 llama-cppView on GitHub →
✨ 1 features🔧 2 symbols
Summary
The server component consolidated slot selection logic into a single function, get_available_slot, while maintaining necessary checks for prompt cache updates. This release also provides numerous pre-compiled binaries for diverse operating systems and hardware configurations.
Migration Steps
- If you were relying on separate logic for slot ID retrieval, note that slot selection is now unified under get_available_slot.
✨ New Features
- Consolidated slot selection logic in the server by absorbing get_slot_by_id into get_available_slot.