Hacker GitHub

← All repos

huggingface/tokenizers

View on GitHub ↗ ★ 11,230 Rust

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

6 mentions on Hacker News by 5 people: 1 story, 5 comments · first 2020-01-13 · latest 2025-06-30

Mentions per year 6 mentions · busiest year 2020 (3)
20082026
AllStoriesComments NewestTopOldest
  1. ▲ 168
    Show HN: HuggingFace – Fast tokenization library for deep-learning NLP pipelines
    story by julien_c · 2020-01-13 · 42 comments