b8665
📦 llama-cppView on GitHub →
✨ 5 features🐛 6 fixes🔧 1 symbols
Summary
This release introduces specialized parsing and improved tool call handling for Gemma 4, alongside various internal cleanups and bug fixes.
Migration Steps
- Rename gemma4.jinja template to match other template naming conventions.
✨ New Features
- Added specialized parser for Gemma 4.
- Added '<|tool_response|>' as an end-of-generation (eog) token.
- Gemma 4 tool call AST now emits
- Added custom template to support interleaved thinking.
- Preserved reasoning in model turns.
🐛 Bug Fixes
- Fixed an initializer error.
- Fixed unused variables.
- Fixed accidental static usage.
- Fixed specialized_template signature.
- Fixed extra semicolon.
- Removed debug line and extra space.