●Change8

Migrating to LocalAI v3.0.0

Version v3.0.0 introduces 2 breaking changes. This guide details how to update your code.

Released: 6/19/2025

2
Breaking Changes
3
Migration Steps
3
Affected Symbols

⚠️ Check Your Code

If you use any of these symbols, you need to read this guide:

Backend GalleryExtras imageslibmtmd

Breaking Changes

●Issue #1

The distribution of “-extra” images containing Python backends has been stopped. Users must now select specific GPU-optimized images or use the new backend gallery to install necessary components.

●Issue #2

Users relying on the old “extras images” must migrate to using the new Backend Gallery system for installing/managing backends.

Migration Steps

  1. 1
    Review the new Docker image naming conventions (e.g., localai/localai:latest-gpu-nvidia-cuda-12) if using containers.
  2. 2
    If you previously used “-extra” images, switch to using the standard images and utilize the Backend Gallery to install required Python-based backends.
  3. 3
    Update any scripts or configurations that relied on the deprecated “-extra” images.

Release Summary

LocalAI 3.0 introduces a major overhaul with the Backend Gallery for dynamic OCI-based backend management, adds WebSocket streaming, and enhances model capabilities with dynamic VRAM handling and multimodal support. This release marks a significant step towards a more modular and powerful local inference platform.

Need More Details?

View the full release notes and all changes for LocalAI v3.0.0.

View Full Changelog