ai-tokenizer
coder/ai-tokenizer
A faster than tiktoken tokenizer with first-class support for Vercel's AI SDK.
61stars
Forks
6
Open issues
4
Watchers
61
Size
13.7 MB
TypeScriptMIT License
aiai-sdkllmtokentokenizer
Created: Oct 9, 2025
Updated: Sep 27, 2026
Last push: Sep 27, 2026