Change8

b9774

📦 llama-cppView on GitHub →
2 features🐛 1 fixes🔧 7 symbols

Summary

This release enhances the Vulkan backend by expanding operator support (SQR, SQRT, SIN, COS, CLAMP, LEAKY_RELU, NORM) and fixing backend compatibility checks for CUDA and WebGPU.

Migration Steps

  1. Handle noncontiguous tensors for norm/l2_norm operations in the CPU backend and l2_norm.comp if you rely on these specific operations.
  2. If using Vulkan, note that SQR/SQRT/SIN/COS/CLAMP/LEAKY_RELU now use unary.comp.

✨ New Features

  • Vulkan backend now supports all backend tests for SQR, SQRT, SIN, COS, CLAMP, and LEAKY_RELU operations by utilizing unary.comp.
  • Vulkan backend now supports noncontiguous tensors for NORM operations.

🐛 Bug Fixes

  • Fixed supports_op check for CUDA and WebGPU backends.

Affected Symbols