Change8

Migrating to llama.cpp b8634

Version b8634 introduces 1 breaking change. This guide details how to update your code.

Released: 4/2/2026

1
Breaking Changes
2
Migration Steps
3
Affected Symbols

⚠️ Check Your Code

If you use any of these symbols, you need to read this guide:

LLM_CHAT_TEMPLATE_GRANITELLM_CHAT_TEMPLATE_GRANITE_3_XLLM_CHAT_TEMPLATE_GRANITE_4_0

Breaking Changes

Issue #1

The constant `LLM_CHAT_TEMPLATE_GRANITE` has been renamed to `LLM_CHAT_TEMPLATE_GRANITE_3_X`. Code relying on the old name for Granite 3.x templates will break and must be updated to use the new constant name.

Migration Steps

  1. 1
    Rename usages of `LLM_CHAT_TEMPLATE_GRANITE` to `LLM_CHAT_TEMPLATE_GRANITE_3_X` if targeting Granite 3.x behavior.
  2. 2
    Use the new constant `LLM_CHAT_TEMPLATE_GRANITE_4_0` for Granite 4.0 models.

Release Summary

This release introduces explicit support for the Granite 4.0 chat template, resolving tool calling issues for this version by updating role mapping. The existing Granite 3.x template constant was renamed for clarity.

Need More Details?

View the full release notes and all changes for llama.cpp b8634.

View Full Changelog