Hacker GitHub

← All repos

markusheimerl/gpt

View on GitHub ↗ ★ 94 C

A generative pretrained transformer implementation

4 mentions on Hacker News by 2 people: 1 story, 3 comments · first 2026-06-05 · latest 2026-06-08

Mentions per year 4 mentions · busiest year 2026 (4)
20082026
AllStoriesComments NewestTopOldest
  1. https://github.com/markusheimerl/gpt/blob/main/train.c - in this file, search for the line "const int batch_size = 15;" - reduce this number
    comment by markusheimerl · 2026-06-08 · in Tiny hackable CUDA language model implementation
  2. …a while back after confirming the backward pass is correct to keep the code base lean - running https://github.com/markusheimerl/gpt/blob/main/transformer/a... is also somewhat of a confirmation that the backward pass is correct, since an…
    comment by markusheimerl · 2026-06-08 · in Tiny hackable CUDA language model implementation
  3. …find numerical gradient checks, which is helpful when verifying that backward pass is correct: https://github.com/markusheimerl/gpt/blob/main/transformer/a...
    comment by yobbo · 2026-06-08 · in Tiny hackable CUDA language model implementation
  4. ▲ 81
    Tiny hackable CUDA language model implementation
    story by markusheimerl · 2026-06-05 · 13 comments