b4rtaz/distributed-llama
View on GitHub ↗ ★ 3,125 C++
Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
16 mentions on Hacker News by 10 people: 11 stories, 5 comments · first 2024-01-20 · latest 2026-02-12
20082026
-
▲ 3
Distributed Llamastory by oldfuture · 2026-02-12 · 0 comments
-
▲ 347
Qwen3 30B A3B Hits 13 token/s on 4xRaspberry Pi 5story by b4rtazz · 2025-09-06 · 161 comments
-
▲ 6
Run Llama 3.3 70B Q40 on $1516 GPU 3.3 tok/sstory by b4rtazz · 2025-04-26 · 0 comments
-
▲ 4
Distributed-Llama: Connect home devices into a cluster for LLM inferencestory by tosh · 2025-02-15 · 1 comment
-
▲ 306
Deepseek R1 Distill 8B Q40 on 4 x Raspberry Pi 5story by b4rtazz · 2025-02-15 · 156 comments
-
▲ 4
Llama 3.1 is available for home AI clusters! Run 8B model with the full contextstory by b4rtazz · 2024-07-25 · 0 comments
-
▲ 2
Run Llama 3 405B on home cluster (Distributed Llama)story by b4rtazz · 2024-07-23 · 1 comment
-
▲ 1
Distributed Grok-1 (314B)story by b4rtazz · 2024-04-15 · 0 comments
-
▲ 12
Show HN: Distributed Llama – Run LLMs on multiple devices in parallelstory by b4rtazz · 2024-01-25 · 0 comments
-
▲ 4
Distributed Llamastory by lagniappe · 2024-01-21 · 0 comments
-
▲ 4
Distributed Llama on Raspberry Pisstory by politelemon · 2024-01-20 · 2 comments