●Change8

Migrating to TGI v3.2.0

Version v3.2.0 introduces 1 breaking change. This guide details how to update your code.

Released: 3/12/2025

1
Breaking Changes
1
Migration Steps
5
Affected Symbols

⚠️ Check Your Code

If you use any of these symbols, you need to read this guide:

tool calling APIOlmo (transformers backend)qwen2qwen vlneuron backend

Breaking Changes

●Issue #1

Tool calling behavior has changed to fully respect OpenAI return results; the arguments return type is now a string instead of a real JSON object. Update code that consumes tool call arguments to handle string input instead of expecting a parsed JSON object.

Migration Steps

  1. 1
    If you rely on the structure of tool call arguments returned by the API, update your parsing logic to expect a string instead of a JSON object.

Release Summary

This release introduces support for the Gemma 3 model and brings significant updates to tool calling behavior, aligning it more closely with OpenAI's specification, alongside various backend and model-specific bug fixes.

Need More Details?

View the full release notes and all changes for TGI v3.2.0.

View Full Changelog