Hacker GitHub

← All repos

anthonix/llm.c

View on GitHub ↗ ★ 63 Cuda

LLM training in simple, raw C/HIP for AMD GPUs

6 mentions on Hacker News by 2 people: 1 story, 5 comments · first 2024-05-29 · latest 2024-07-15

Mentions per year 6 mentions · busiest year 2024 (6)
20082026
AllStoriesComments NewestTopOldest
  1. …I've also trained the larger GPT2-XL model from scratch on bigger CDNA machines. Works fine. [1] https://github.com/anthonix/llm.c [2] https://x.com/zealandic1
    comment by anthonix1 · 2024-07-15 · in Run CUDA, unmodified, on AMD GPUs
  2. …[2] https://www.amd.com/content/dam/amd/en/documents/radeon-tech... [3] http://github.com/anthonix/llm.c
    comment by anthonix1 · 2024-07-15 · in Run CUDA, unmodified, on AMD GPUs
  3. ▲ 6
    Fork of Llm.c for AMD Devices
    story by benterix · 2024-06-04 · 0 comments
  4. Yeah, I just reproduced the GPT2 from scratch results in 8.75 hours on 4x 7900 XTX. The fork is here: https://github.com/anthonix/llm.c
    comment by anthonix1 · 2024-05-29 · in Reproducing GPT-2 in llm.c
  5. …a bug in my attention / matmul kernels, but after fixing that and restarting it worked great [1] https://github.com/anthonix/llm.c
    comment by anthonix1 · 2024-05-29 · in Reproducing GPT-2 in llm.c
  6. …is ~97ms, Karpathy's llm.c with ROCm is ~79ms, and llm.c with custom kernels is ~58ms [1] https://github.com/anthonix/llm.c [2] https://github.com/tinygrad/tinygrad/issues/4301
    comment by anthonix1 · 2024-05-29 · in Tinygrad 0.9.0