← All repos

tysam-code/hlb-gpt

View on GitHub ↗ ★ 361 Python

Minimalistic, extremely fast, and hackable researcher's toolbench for GPT models in 307 lines of code. Reaches <3.8 validation loss on wikitext-103 on a single A100 in <100 seconds. Scales to larger models with one parameter change (feature currently in alpha).

3 mentions on Hacker News by 1 person: 0 stories, 3 comments · first 2023-04-02 · latest 2023-05-23