srush/GPU-Puzzles
View on GitHub ↗ ★ 12,556 Jupyter Notebook
Solve puzzles. Learn CUDA.
20 mentions on Hacker News by 18 people: 9 stories, 11 comments · first 2022-07-12 · latest 2026-06-19
20082026
-
…If that's your thing here are some other writing you might be interested in. * Thinking about cuda: http://github.com/srush/gpu-puzzles * Tensors considered harmful: https://nlp.seas.harvard.edu/NamedTensor * Differentiating SVG:…
comment by srush · 2025-08-26 · in The Annotated Transformer (2022) -
…in an hardware agnostic way and verify understanding with implementation puzzle. It is based on https://github.com/srush/GPU-Puzzles but is CUDA specific.
comment by CalmDream · 2025-06-14 · in Ask HN: How to learn CUDA to professional level -
…Book: Programming massively parallel processors nvidia cuda docs are very comprehensive too https://github.com/srush/GPU-Puzzles
comment by imjonse · 2025-06-08 · in Ask HN: How to learn CUDA to professional level -
There are already some resources like that like: leetgpu.com https://github.com/srush/GPU-Puzzles For me its about a sense of progress, like in chess you can have an ELO score. Or in Duolingo theres a roadmap. If there were levels to this…
comment by imranq · 2025-03-22 · in Pen and Paper Exercises in Machine Learning (2022) -
…to Metal [2]. I think it's a very accessible introduction to Metal and writing GPU kernels. [1] https://github.com/srush/GPU-Puzzles [2] https://github.com/abeleinin/Metal-Puzzles
comment by aleinin · 2024-12-25 · in Ask HN: Resources for general purpose GPU development on Apple's M* chips? -
…of GPU experts. So, if you're ready to dive into the world of GPU programming, head over to https://github.com/srush/GPU-Puzzles and let the learning begin! Looking forward to your thoughts and contributions. Let's push the limits together!
comment by Aiden242 · 2024-09-27 · in "Unlock GPU Power: GPU-Puzzles, Your GPU Innovation Hub" -
This: https://github.com/srush/GPU-Puzzles/raw/main/GPU_puzzlers_f...
comment by xandrius · 2024-09-23 · in GPU Puzzles -
…If you enjoy this type of thing, I made a bunch more. They're all kind of ML + PL in style. - https://github.com/srush/gpu-puzzles - https://github.com/srush/tensor-puzzles - https://github.com/srush/autodiff-puzzles -…
comment by srush · 2024-05-22 · in Tensor Puzzles -
A great beginner guide to GPU programming concepts: https://github.com/srush/GPU-Puzzles
comment by convexstrictly · 2023-11-12 · in GPU Survival Toolkit for the AI age -
…dirty to try to understand a concept. Another example is Sasha Rush's gpu puzzles, tensor puzzles - https://github.com/srush/GPU-Puzzles - https://github.com/srush/Tensor-Puzzles
comment by eachro · 2023-08-25 · in Understanding Automatic Differentiation in 30 lines of Python -
…time. There's also a set of GPU puzzles for beginners [1] using to get started with numba CUDA. [1] https://github.com/srush/GPU-Puzzles
comment by luckyt · 2023-07-17 · in FlashAttention-2, 2x faster than FlashAttention