Change8

b10232

📦 llama-cppView on GitHub →
3 features🔧 3 symbols

Summary

This release introduces DeepSeek V4 hyper-connections with optimized kernels for Metal. It also provides pre-compiled binaries for various platforms and hardware configurations.

✨ New Features

  • Implement DeepSeek V4 hyper-connections with SIMDgroup register and shuffle optimized kernels.
  • Add Metal dispatch and support plumbing for DeepSeek V4 hyper-connections.
  • Test production Sinkhorn iteration count and embedding width for DeepSeek V4 hyper-connections.

Affected Symbols