b9284
📦 llama-cppView on GitHub →
🐛 1 fixes🔧 1 symbols
Summary
This release addresses a critical bug in the HybridDNA tokenizer to prevent BPE token collisions and includes numerous pre-compiled binaries for various operating systems and hardware configurations.
🐛 Bug Fixes
- Fixed an issue in the HybridDNA tokenizer by marking k-mers to prevent BPE token collisions.