v3.3.4
📦 tgiView on GitHub →
✨ 2 features🐛 1 fixes🔧 1 symbols
Summary
This release introduces initial support for Gemma 3 models on Gaudi and fixes a bug related to Neuron models exported with batch_size 1.
✨ New Features
- Initial support for Gemma 3 text and VLM models on Gaudi.
- Added support for Gemma 3 text and VLM models on Gaudi (requires adding sliding window support).
🐛 Bug Fixes
- Fixed an issue affecting Neuron models exported with batch_size 1.
🔧 Affected Symbols
Neuron backend