labmlai/annotated_deep_learning_paper_implementations

View on GitHub ↗ ★ 67,734 Python

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

5 mentions on Hacker News by 3 people: 2 stories, 3 comments · first 2021-08-13 · latest 2023-01-11

Mentions per year 5 mentions · busiest year 2021 (2)

20082026

All Stories Comments Newest Top Oldest

Yes, see DeepMind RETRO: > In our experiments on the Pile, a standard language modeling benchmark, a 7.5 billion parameter RETRO model outperforms the 175 billion parameter Jurassic-1 on 10 out of 16 datasets and outperforms the 280B…
comment by ignoramous · 2023-01-11 · in NanoGPT
Generate Quotes: https://neox.labml.ai/quote Annotated implementation: https://nn.labml.ai/neox/index.html Github: https://github.com/labmlai/annotated_deep_learning_paper_imp...
comment by hnipun · 2022-08-14 · in Show HN: Use GPT-NeoX to generate quotes
Github: https://github.com/labmlai/annotated_deep_learning_paper_imp... Tweet on the implementation: https://twitter.com/labmlai/status/1425809861028192267 Tweet by Deepmind on PonderNet: https://twitter.com/DeepMind/status/1425814786080608…
comment by vpj · 2021-08-13 · in PonderNet: Annotated PyTorch Implementation