●Change8

Migrating to LocalAI v2.26.0

Version v2.26.0 introduces 5 breaking changes. This guide details how to update your code.

Released: 2/15/2025

5
Breaking Changes
4
Migration Steps
9
Affected Symbols

⚠️ Check Your Code

If you use any of these symbols, you need to read this guide:

vall-e-xOpenvoicestablediffusion-NCNstablediffusion-ggmlllama-ggmlMambaTransformers-MusicgenSentencetransformerstransformers

Breaking Changes

●Issue #1

Several backends have been dropped and replaced for improved performance and compatibility.

●Issue #2

`Vall-e-x` and `Openvoice` backends have been dropped as they are superseded by Kokoro and OutelTTS.

●Issue #3

The `stablediffusion-NCN` backend was replaced with the `stablediffusion-ggml` implementation.

●Issue #4

The deprecated `llama-ggml` backend has been dropped; LocalAI now only supports GGUF models.

●Issue #5

Mamba, Transformers-Musicgen, and Sentencetransformers functionalities have been merged into the `transformers` backend. Configuration files referencing these old backend names might need updating to use `transformers`.

Migration Steps

  1. 1
    If you were using `Vall-e-x` or `Openvoice`, migrate to the Kokoro or OutelTTS backends.
  2. 2
    If you were using `stablediffusion-NCN`, switch to using `stablediffusion-ggml`.
  3. 3
    If you were using the deprecated `llama-ggml` backend, ensure your models are in GGUF format and update configurations to use the GGUF support.
  4. 4
    Review configurations for Mamba, Transformers-Musicgen, and Sentencetransformers; they may need to be aliased or updated to use the `transformers` backend explicitly.

Release Summary

LocalAI v2.26.0 introduces significant backend consolidation, dropping deprecated TTS and LLM backends in favor of modern alternatives like GGUF and new TTS options. This release also adds support for Nvidia L4T devices and introduces lazy grammar features for llama.cpp.

Need More Details?

View the full release notes and all changes for LocalAI v2.26.0.

View Full Changelog