Migrating to Tokenizers v0.21.3
Version v0.21.3 introduces 1 breaking change. This guide details how to update your code.
Released: 7/4/2025
1
Breaking Changes
0
Migration Steps
0
Affected Symbols
Breaking Changes
●Issue #1
A backward breaking change was introduced in the Rust APIs and has been fixed.
Release Summary
This patch release addresses Clippy fixes and resolves an introduced backward breaking change in the Rust APIs.
Need More Details?
View the full release notes and all changes for Tokenizers v0.21.3.
View Full Changelog