rstebbing/workshop
View on GitHub ↗ ★ 13 Python
3 mentions on Hacker News by 1 person: 0 stories, 3 comments · first 2023-01-29 · latest 2023-04-26
20082026
-
…year to better help visualize the internals of a transformer block when applied to a toy problem: https://github.com/rstebbing/workshop/tree/main/experiments/... . It is not super long, and the point is to try and better distinguish…
comment by whoateallthepy · 2023-04-26 · in Transformers from Scratch (2021) -
…can go wrong, and how it can be improved, etc. The walkthrough and code is all available here: https://github.com/rstebbing/workshop/tree/main/experiments/... . It's not terse like nanoGPT or similar because the goal is a bit different. In…
comment by whoateallthepy · 2023-02-11 · in Understanding and coding the self-attention mechanism of large language models -
…Everything is reproducible, so hopefully helpful at getting used to some of the tooling too! https://github.com/rstebbing/workshop/tree/main/experiments/...
comment by whoateallthepy · 2023-01-29 · in The Transformer Family