Change8

b8471

📦 llama-cppView on GitHub →
2 features

Summary

This release introduces support for bf16 and quantized data types. It also provides updated pre-compiled binaries for macOS, Linux, Windows, and openEuler across various CPU/GPU backends.

✨ New Features

  • Support for bf16 data type.
  • Support for quantized types.