gguf

This release includes a fix for checking the GGUF array type before reading, addressing a potential issue in data processing. It also provides updated binary releases for various platforms and hardware configurations.

This release includes various fixes for the mtmd and common modules, along with a reverted GGUF fix.

This release introduces the minicpmv46 downsample functionality and integrates it within gguf. It also includes the build for mtmd_image_preprocessor_llava_uhd and a 4x ignore vit merger, along with code fixes.

This release includes a fix for the gguf format by rejecting empty metadata keys. It also provides updated pre-compiled binaries for various platforms and hardware configurations.

This release includes an optimization in the GGUF implementation to reduce unnecessary file size calls and provides updated pre-built binaries for various operating systems and hardware configurations.

This release addresses a bug related to ftell/fseek functionality on Windows within the gguf component and provides updated pre-compiled binaries for macOS, Linux, Windows, and openEuler.

This release introduces several new features, including streaming token usage, GGUF template reading, and enhanced llama.cpp cache configuration. It also includes numerous updates to the model gallery and a fix for the llava clip patch.