← All repos

google/sentencepiece

View on GitHub ↗ ★ 12,163 C++

Unsupervised text tokenizer for Neural Network-based text generation.

11 mentions on Hacker News by 11 people: 1 story, 10 comments · first 2018-09-06 · latest 2025-06-30