Hacker GitHub

← All repos

javirandor/anthropic-tokenizer

View on GitHub ↗ ★ 173 Python

Approximation of the Claude 3 tokenizer by inspecting generation stream

4 mentions on Hacker News by 4 people: 2 stories, 2 comments · first 2024-03-12 · latest 2024-06-18

Mentions per year 4 mentions · busiest year 2024 (4)
20082026
AllStoriesComments NewestTopOldest
  1. ▲ 9
    Approximation of the Claude 3 tokenizer by inspecting generation stream
    story by tosh · 2024-03-22 · 1 comment
  2. ▲ 2
    The Worst (But Only) Claude 3 Tokenizer
    story by dpaleka · 2024-03-12 · 0 comments