sentencepiece
google/sentencepiece
Unsupervised text tokenizer for Neural Network-based text generation.
11,864stars
Forks
1,352
Open issues
17
Watchers
11,864
Size
42.0 MB
C++Apache License 2.0
natural-language-processingneural-machine-translationword-segmentation
Created: Mar 7, 2017
Updated: May 29, 2026
Last push: May 28, 2026