Change8

b8821

📦 llama-cppView on GitHub →
2 features🔧 1 symbols

Summary

This release enhances server functionality by allowing environment variable control over media markers and makes the media marker retrieval thread-safe. It also provides extensive pre-built binaries for diverse platforms.

✨ New Features

  • Allow pinning the media marker via the LLAMA_MEDIA_MARKER environment variable, which is checked before falling back to random marker generation.
  • Updated server tests to fetch random media marker via /apply-template endpoint.

Affected Symbols