bigscience-workshop/petals
View on GitHub ↗ ★ 10,682 Python
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
53 mentions on Hacker News by 40 people: 3 stories, 50 comments · first 2022-12-13 · latest 2026-10-20
20082026
-
https://github.com/bigscience-workshop/petals Since my other account is shadow banned for some unexplained reason, I just wanted to mention the petal project. It's an attempt to bittorrent style distribute the load of running these large…
comment by chamwislothe2nd · 2022-12-29 · in Ask HN: Can I download GPT / ChatGPT to my desktop? -
https://github.com/bigscience-workshop/petals
comment by bookofjoe · 2022-12-25 · in Petals is creating a free, distributed network for running text-generating AI -
▲ 3
Show HN: Run and fine-tune 175B+ LMs in Colab using a P2P network of GPUsstory by borzunov · 2022-12-13 · 0 comments