Change8

Tiktoken

AI & LLMs

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

Latest: 0.12.03 releasesView on GitHub →

Release History