b7631
📦 llama-cppView on GitHub →
✨ 4 features🔧 4 symbols
Summary
This release focuses on internal refactoring of rope frequency scaling initialization and conversion, alongside adding utility functions and logging for SWA information.
✨ New Features
- Added get_rope_freq_scale function to modern-bert implementation.
- Refactored rope_freq_base/scale_swa conversion and initialization logic.
- Implemented safe defaults for unknown configuration values.
- Added logging for SWA (Scale Weight Average) information.
🔧 Affected Symbols
rope_freq_basescale_swaget_rope_freq_scalemodern-bert