●Change8

Migrating to TGI v3.3.5

Version v3.3.5 introduces 1 breaking change. This guide details how to update your code.

Released: 9/2/2025

1
Breaking Changes
1
Migration Steps
1
Affected Symbols

⚠️ Check Your Code

If you use any of these symbols, you need to read this guide:

HeterogeneousNextTokenChooser

Breaking Changes

●Issue #1

Migration to V2 Pydantic interface may break configurations or code relying on the V1 interface. Review any custom Pydantic models or configuration loading logic.

Migration Steps

  1. 1
    If you were using Pydantic V1 interfaces, update your code to comply with the new V2 Pydantic interface.

Release Summary

This release introduces significant hardware acceleration updates, including V2 Pydantic migration, XPU LoRA support, and various Gaudi optimizations for models like Gemma3 and Deepseek v2. It also bumps core dependencies like transformers and huggingface_hub.

Need More Details?

View the full release notes and all changes for TGI v3.3.5.

View Full Changelog