Star AlbumentationsX on GitHub — it powers this leaderboard

Star on GitHub
← Back to leaderboard
openai

tiktoken

openai/tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

17,416stars
View on GitHub
Forks
1,388
Open issues
85
Watchers
17,416
Size
0.1 MB
PythonMIT License
Created: Dec 1, 2022
Updated: Feb 28, 2026
Last push: Feb 8, 2026