Hacker GitHub

← All repos

JonasGeiping/cramming

View on GitHub ↗ ★ 1,370 Python

Cramming the training of a (BERT-type) language model into limited compute.

3 mentions on Hacker News by 2 people: 1 story, 2 comments · first 2022-12-31 · latest 2023-01-11

Mentions per year 3 mentions · busiest year 2023 (2)
20082026
AllStoriesComments NewestTopOldest
  1. …Training a Language Model on a Single GPU in One Day' https://arxiv.org/abs/2212.14034 and https://github.com/JonasGeiping/cramming
    comment by homarp · 2023-01-11 · in NanoGPT
  2. Paper and repo: https://github.com/JonasGeiping/cramming
    comment by gardenfelder · 2022-12-31 · in Lucas Beyer on Twitter: “How Good of a Bert Can One Get in One Day on One GPU?