Change8

v3.5.1

📦 localaiView on GitHub →
4 features🐛 7 fixes🔧 3 symbols

Summary

This release introduces a new launcher welcome page and support for the HF_ENDPOINT environment variable. It also includes numerous bug fixes, dependency updates, and adds support for diarization in Whisper models.

✨ New Features

  • Added welcome page to the launcher.
  • Support for HF_ENDPOINT environment variable for the HuggingFace endpoint.
  • Whisper model now supports diarization via tinydiarize.
  • Chatterbox backend now supports MPS and CPU, with version pinning.

🐛 Bug Fixes

  • Ensured all processes are shut down correctly upon exit.
  • Automatically install llama-cpp for p2p workers.
  • Updated LLava documentation link to point to LocalAI-examples repo.
  • Fixed runtime capability detection for backends.
  • Used proper finish_reason for tool/function calling in chat.
  • Renamed tag suffix for hipblas whisper build to match backend configuration.
  • Correctly calculate embeddings in llama-cpp backend.

🔧 Affected Symbols

llama-cppwhisperchatterbox