rasbt/LLMs-from-scratch
View on GitHub ↗ ★ 107,687 Jupyter Notebook
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
33 mentions on Hacker News by 22 people: 18 stories, 15 comments · first 2024-01-27 · latest 2026-10-26
20082026
-
▲ 2
DeepSeek Sparse Attentionstory by eigenBasis · 2026-05-24 · 0 comments
-
▲ 1
Olmo 3 from Scratch (Standalone Notebook)story by quietlearning · 2025-11-24 · 0 comments
-
▲ 3
Explanation of Gated DeltaNet (Qwen3-Next and Kimi Linear)story by ModelForge · 2025-11-03 · 0 comments
-
▲ 417
Gemma 3 270M re-implemented in pure PyTorch for local tinkeringstory by ModelForge · 2025-08-20 · 57 comments
-
▲ 3
Qwen3 from Scratchstory by tzury · 2025-08-02 · 0 comments
-
▲ 3
Qwen3 Implemented from Scratchstory by sbbq · 2025-06-20 · 0 comments
-
▲ 2
Implement a ChatGPT-like LLM in PyTorch from scratch, step by stepstory by jinqueeny · 2025-04-24 · 0 comments
-
▲ 1
Day 1 of trying to fit a Chatbot into a QR Codestory by kuberwastaken · 2025-04-20 · 2 comments
-
▲ 2
Python Setup Tipsstory by tosh · 2025-02-16 · 0 comments
-
▲ 5
Implementing the Llama 3.2 1B and 3B Architectures from Scratchstory by sbbq · 2024-10-05 · 0 comments
-
▲ 2
Converting GPT to Llama step-by-step code guidestory by sbbq · 2024-09-23 · 0 comments
-
▲ 2
LLM instruction finetuning from-scratch tutorialstory by sbbq · 2024-06-17 · 0 comments
-
▲ 2
Evaluating LLMs locally, on a laptop, with Llama 3 and Ollamastory by rasbt · 2024-06-13 · 0 comments
-
▲ 14
Finetuning an LLM-Based Spam Classifier with LoRA from Scratchstory by rasbt · 2024-05-11 · 0 comments
-
▲ 3
Finetune a GPT Model for Spam Detection on Your Laptop in Just 5 Minutesstory by rasbt · 2024-05-03 · 0 comments
-
▲ 2
Insights from Finetuning LLMs for Classification Tasksstory by rasbt · 2024-04-28 · 0 comments
-
▲ 3
Comparing 5 ways to implement Multihead Attention in PyTorchstory by rasbt · 2024-03-08 · 0 comments
-
▲ 739
Implementing a ChatGPT-like LLM from scratch, step by stepstory by rasbt · 2024-01-27 · 98 comments