bigscience-workshop/petals
View on GitHub ↗ ★ 10,682 Python
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
53 mentions on Hacker News by 40 people: 3 stories, 50 comments · first 2022-12-13 · latest 2026-10-20
20082026
-
▲ 5
Petals runs Llama 2 (70B) from Colab at 5 tokens/secstory by borzunov · 2023-07-19 · 3 comments
-
▲ 594
Petals: Run 100B+ language models at home bit-torrent stylestory by antman · 2023-01-02 · 155 comments
-
▲ 3
Show HN: Run and fine-tune 175B+ LMs in Colab using a P2P network of GPUsstory by borzunov · 2022-12-13 · 0 comments