Hacker GitHub

← All repos

HazyResearch/ThunderKittens

View on GitHub ↗ ★ 3,790 Cuda

Tile primitives for speedy kernels

10 mentions on Hacker News by 9 people: 2 stories, 8 comments · first 2024-05-12 · latest 2025-11-15

Mentions per year 10 mentions · busiest year 2024 (8)
20082026
AllStoriesComments NewestTopOldest
  1. Anyone know whether there are things built on https://github.com/HazyResearch/ThunderKittens ? I think this is a port of that to HIP, where generally ports of cuda things to hip are of vague professional interest, but much more so if the…
    comment by JonChesterfield · 2025-11-15 · in HipKittens: Fast and furious AMD kernels
  2. Wowzers, the line noise https://github.com/HazyResearch/ThunderKittens#:~:text=here%...
    comment by mdaniel · 2025-06-08 · in Ask HN: How to learn CUDA to professional level
  3. …with handwritten cuda kernels > How easy is it to run on older GPUs this is a torch cpp extension https://github.com/HazyResearch/ThunderKittens/blob/8daffc9c... so you're going to have the same exact issue (whatever issue you're having)
    comment by almostgotcaught · 2024-10-30 · in ThunderKittens: Simple, fast, and adorable AI kernels
  4. …There's only one project I'm aware of that seriously tries to address the Cuda issue in ml [1]. [0] https://github.com/HazyResearch/ThunderKittens?tab=readme-ov... [1] https://github.com/vosen/ZLUDA
    comment by eyegor · 2024-07-12 · in FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-Precision
  5. ▲ 1
    ThunderKittens: A framework to write fast deep learning kernels in CUDA
    story by PaulHoule · 2024-06-03 · 0 comments
  6. ▲ 3
    ThunderKittens: Tile Primitives for Speedy Kernels
    story by flakiness · 2024-05-17 · 0 comments
  7. …are utilization numbers for our attention backwards kernels (causal and non-causal, head dim = 64): https://github.com/HazyResearch/ThunderKittens/blob/main/att...
    comment by Aaryan44 · 2024-05-14 · in GPUs Go Brrr
  8. …of the flash attention backwards pass with TK - would love for you to check them out! causal: https://github.com/HazyResearch/ThunderKittens/blob/main/exa... non-causal: https://github.com/HazyResearch/ThunderKittens/blob/main/exa...
    comment by Aaryan44 · 2024-05-13 · in GPUs Go Brrr
  9. wow their graphs at the GitHub README ( https://github.com/HazyResearch/ThunderKittens/blob/main/att... ) make me extremely dizzy. Are these wavy bars even legal? :P
    comment by joaquincabezas · 2024-05-13 · in GPUs Go Brrr
  10. The ThunderKittens mascot has great kitten/Sony-Aibo vibes. Nicely generated, AI (I presume). https://github.com/HazyResearch/ThunderKittens
    comment by jauntywundrkind · 2024-05-12 · in GPUs Go Brrr