evilsocket/cake
View on GitHub ↗ ★ 3,132 Rust
Distributed inference for mobile, desktop and server.
4 mentions on Hacker News by 4 people: 2 stories, 2 comments · first 2024-07-19 · latest 2026-03-25
20082026
-
…a "piece" of a "mega model" inference or training. Kind of like SETI@home but for an open LLM (like https://github.com/evilsocket/cake but massive ) Ideally if you "participate" in the network, you would get "credits" to use it…
comment by xtracto · 2026-03-25 · in Ensu – Ente’s Local LLM app -
▲ 3
Cake: Distributed LLM and StableDiffusion inference for mobile desktop or serverstory by ethanpil · 2025-02-18 · 1 comment
-
Would this help? https://github.com/evilsocket/cake
comment by muzani · 2024-07-26 · in How can I do my research as a GPU poor? -
▲ 2
Cake: a Rust framework for distributed inference of large models like LLama3story by mnoorfawi · 2024-07-19 · 0 comments