b10182
Breaking Changes📦 llama-cppView on GitHub →
⚠ 1 breaking✨ 1 features🐛 1 fixes🔧 4 symbols
Summary
This release refactors suppress tokens handling to a common sampling module and addresses security issues. The `has_logit_bias` parameter has been removed.
⚠️ Breaking Changes
- The `has_logit_bias` parameter has been removed. Users should adapt their code to use the new `suppress_tokens` handling in common/sampling.
Migration Steps
- Refactor code that uses `has_logit_bias` to utilize the updated `suppress_tokens` functionality within the common sampling module.
✨ New Features
- Suppress tokens handling has been moved to a common sampling module for better code organization and reusability.
🐛 Bug Fixes
- Addressed security issues.