Change8

v3.3.0

📦 localaiView on GitHub →
3 features🐛 2 fixes1 deprecations🔧 2 symbols

Summary

LocalAI 3.3.0 introduces object detection capabilities via a new API and improves backend download reliability with defined mirrors. This release also includes various bug fixes across container images, backends, and installation scripts.

Migration Steps

  1. If you rely on the assistants endpoint, note that it has been removed in this version.
  2. To use object detection, install the 'rfdetr-base' model and refer to the documentation.

✨ New Features

  • Added support for object detection via a new API, requiring the installation of the 'rfdetr-base' model.
  • Backends now have defined mirrors for download to improve reliability when primary registries fail.
  • Normalized search functionality.

🐛 Bug Fixes

  • Fixed issues related to container images, backends, and installation scripts.
  • Re-added exllama2 support for intel images for python-based backends.

🔧 Affected Symbols

rfdetr-baseexllama2

⚡ Deprecations

  • The assistants endpoint has been dropped.