●Change8

Migrating to LocalAI v3.2.0

Version v3.2.0 introduces 2 breaking changes. This guide details how to update your code.

Released: 7/24/2025

2
Breaking Changes
2
Migration Steps
5
Affected Symbols

⚠️ Check Your Code

If you use any of these symbols, you need to read this guide:

llama.cppwhisper.cpppiperstablediffusion-ggml/v1/chat/completions

Breaking Changes

●Issue #1

The core is now separated from all inference backends (llama.cpp, whisper.cpp, piper, stablediffusion-ggml, etc.). These are no longer bundled in the main binary.

●Issue #2

Existing models installed prior to v3.2.0 might not have a specific backend assigned and may require manual backend installation after upgrading for them to function.

Migration Steps

  1. 1
    If you have existing models installed before upgrading to 3.2.0, you may need to install the required backend manually for these models to work. Use the WebUI or the CLI command: `local-ai backends install <backend_name>`.
  2. 2
    For advanced use cases or to override auto-detection of hardware capabilities, use the LOCALAI_FORCE_META_BACKEND_CAPABILITY environment variable (options: default, nvidia, amd, intel).

Release Summary

LocalAI 3.2.0 introduces a major architectural shift by separating inference backends from the core binary, resulting in a leaner application and enabling independent backend management. This release also adds automatic hardware detection for backend installation and expands model support significantly.

Need More Details?

View the full release notes and all changes for LocalAI v3.2.0.

View Full Changelog