b8094
📦 llama-cppView on GitHub →
✨ 1 features🐛 1 fixes🔧 1 symbols
Summary
This release introduces server-side debugging by saving generated text for the /slots endpoint based on the LLAMA_SERVER_SLOTS_DEBUG environment variable.
✨ New Features
- Server now saves generated text for the /slots endpoint when LLAMA_SERVER_SLOTS_DEBUG is set to 1 or greater.
🐛 Bug Fixes
- The debug_generated_text is now only updated when LLAMA_SERVER_SLOTS_DEBUG is greater than 0.