Migrating to llama.cpp b9908
Version b9908 introduces 2 breaking changes. This guide details how to update your code.
Released: 7/8/2026
⚠️ Check Your Code
If you use any of these symbols, you need to read this guide:
--cache-ramBreaking Changes
●Issue #1
The behavior of the prompt cache RAM limit (--cache-ram) has changed to be a strict limit. Previously, the cache might temporarily exceed limits or preserve one entry regardless of size. Now, entries exceeding the RAM limit alone are skipped, and older entries are evicted aggressively to make space for new entries.
●Issue #2
Token-limit cleanup may now evict the last remaining cache entry, whereas previously one entry was always preserved.
Migration Steps
- 1If you rely on the prompt cache always preserving at least one entry even if it exceeds the RAM limit, be aware that this behavior is removed. Adjust your --cache-ram settings or expected memory usage accordingly.
Release Summary
This release enforces a strict RAM limit for the prompt cache, ensuring entries exceeding the limit are skipped and aggressively evicting old entries to maintain the limit. It also updates the availability of pre-built binaries across multiple platforms.
Need More Details?
View the full release notes and all changes for llama.cpp b9908.
View Full Changelog