b9100
📦 llama-cppView on GitHub →
✨ 1 features🐛 1 fixes🔧 2 symbols
Summary
This release introduces support for returning post-sampling probabilities from the backend sampling process and ensures post-sampling probabilities are never zero on the server side. Numerous platform-specific binaries are also provided.
✨ New Features
- Backend sampling now supports returning post-sampling probabilities.
🐛 Bug Fixes
- The server component is guaranteed never to return 0.0 for post-sampling probabilities.