MakazhanAlpamys/Soup
View on GitHub ↗ ★ 10,470 Python
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
3 mentions on Hacker News by 2 people: 1 story, 2 comments · first 2026-08-04 · latest 2026-08-04
20082026
-
There are some samples of training data in this folder - https://github.com/MakazhanAlpamys/Soup/tree/main/examples/d... They're all very short though. Anyone got a good rule for how much data of this nature is needed to successfully…
comment by simonw · 2026-08-04 · in Show HN: Fine-tune an 8B model on a 4 GB laptop GPU -
…numbers are Windows, so pessimistic vs Linux. Measurement records, including the ones I threw away: https://github.com/MakazhanAlpamys/Soup/tree/main/benchmarks Write-up: https://doi.org/10.5281/zenodo.21771064 Happy to answer anything…
comment by MakazhanAlpamys · 2026-08-04 · in Show HN: Fine-tune an 8B model on a 4 GB laptop GPU