Change8

b9038

📦 llama-cppView on GitHub →
1 features🔧 1 symbols

Summary

This release enhances memory estimation for OpenCL backends during model fitting by utilizing CL_DEVICE_GLOBAL_MEM_SIZE. It also provides a comprehensive set of pre-compiled binaries for diverse platforms.

✨ New Features

  • ggml now uses CL_DEVICE_GLOBAL_MEM_SIZE as the memory estimate when running with OpenCL and the --fit flag.

Affected Symbols