ai-tokenizer
coder/ai-tokenizer
A faster than tiktoken tokenizer with first-class support for Vercel's AI SDK.
51stars
Forks
3
Open issues
2
Watchers
51
Size
15.8 MB
TypeScriptMIT License
aiai-sdkllmtokentokenizer
Created: Oct 9, 2025
Updated: Apr 11, 2026
Last push: Dec 1, 2025