Hacker GitHub

← All repos

learning-at-home/hivemind

View on GitHub ↗ ★ 2,548 Python

Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

15 mentions on Hacker News by 12 people: 2 stories, 13 comments · first 2020-05-30 · latest 2025-06-02

Mentions per year 15 mentions · busiest year 2023 (9)
20082026
AllStoriesComments NewestTopOldest
  1. …for LLMs. Here are two projects I found from a quick search: Serving: https://petals.dev/ Training: https://github.com/learning-at-home/hivemind
    comment by esafak · 2025-06-02 · in EasyTier – P2P mesh VPN written in Rust using Tokio
  2. https://github.com/learning-at-home/hivemind is also relevant
    comment by woctordho · 2024-03-08 · in Fine tune a 70B language model at home
  3. …was also used to build Petals[2] but it only supports fine-tuning and inference[3] afaik. [1] https://github.com/learning-at-home/hivemind [2] https://github.com/bigscience-workshop/petals [3] https://chat.petals.dev/
    comment by dvmazur · 2023-11-23 · in Exponentially faster language modelling
  4. ▲ 2
    Hivemind: Train deep learning models on thousands of volunteers across the world
    story by agnosticmantis · 2023-06-20 · 0 comments
  5. …chapters (5 and 6 in particular) addressing potential attacks, failure modes, and bias [1]. 0: https://github.com/learning-at-home/hivemind 1: https://arxiv.org/abs/1912.04977
    comment by techwizrd · 2023-03-21 · in Run 100B+ language models at home, BitTorrent‑style
  6. …learning. > Hivemind is a PyTorch library for decentralized deep learning across the Internet. 0: https://github.com/learning-at-home/hivemind
    comment by techwizrd · 2023-03-21 · in Run 100B+ language models at home, BitTorrent‑style
  7. The Hivemind project is just that https://github.com/learning-at-home/hivemind
    comment by ikmckenz · 2023-03-18 · in SETI@home is in hibernation
  8. …uses, but you'll have to create your own community for whatever model you're trying to train. https://github.com/learning-at-home/hivemind
    comment by nodja · 2023-02-20 · in Running large language models like ChatGPT on a single GPU
  9. Yes, hivemind trained a gpt 6B model like this. General model training https://github.com/learning-at-home/hivemind Stable diffusion specific https://github.com/chavinlo/distributed-diffusion Inference only stable diffusion…
    comment by nodja · 2023-01-26 · in Training Stable Diffusion from Scratch Costs <$160k
  10. …(author thread: https://twitter.com/SamuelAinsworth/status/15697194946455265... ) See also: https://github.com/learning-at-home/hivemind and more to OP's incentive structure: https://docs.bittensor.com/ Latter two intend to beat latency…
    comment by vagabund · 2023-01-12 · in Ask HN: Can you crowdfund the compute for GPT?
  11. There absolutely are! Check out hivemind ( https://github.com/learning-at-home/hivemind ), a general library for deep learning over the Internet, or Petals ( https://petals.ml/ ), a system that leverages Hivemind and allows you to run…
    comment by mryab · 2023-01-11 · in NanoGPT
  12. …latency and low bandwidth between them. That may change though - there are people working on it: https://github.com/learning-at-home/hivemind
    comment by rewq4321 · 2021-11-07 · in GPT-3 is no longer the only game in town
  13. ▲ 4
    Hivemind: Decentralized Deep Learning in PyTorch
    story by T-A · 2021-10-25 · 1 comment
  14. It is going on, see https://github.com/learning-at-home/hivemind and https://github.com/bytedance/fedlearner
    comment by nshm · 2020-08-23 · in Future of DeepSpeech / STT after recent changes at Mozilla
  15. …experts. You can read it on ArXiv https://arxiv.org/abs/2002.04013v1 or browse the code here: https://github.com/learning-at-home/hivemind . It's not ready for widespread use yet, but the core functionality is stable and you can see what…
    comment by mryab · 2020-05-30 · in GPT-3: A Disappointing Paper?