Change8

b9442

📦 llama-cppView on GitHub →
2 features🐛 1 fixes🔧 1 symbols

Summary

This release introduces new tokenizer support for jina-embeddings-v2-base-zh and sets the default for lowercase tokenization to true, alongside various platform-specific binary updates.

✨ New Features

  • Added tokenizer support for jina-embeddings-v2-base-zh.
  • The default setting for lowercase tokenization is now true.

🐛 Bug Fixes

  • Fixed a type issue related to vocab processing.

Affected Symbols