evilsocket/cake
View on GitHub ↗ ★ 3,132 Rust
Distributed inference for mobile, desktop and server.
4 mentions on Hacker News by 4 people: 2 stories, 2 comments · first 2024-07-19 · latest 2026-03-25
20082026
-
▲ 3
Cake: Distributed LLM and StableDiffusion inference for mobile desktop or serverstory by ethanpil · 2025-02-18 · 1 comment
-
▲ 2
Cake: a Rust framework for distributed inference of large models like LLama3story by mnoorfawi · 2024-07-19 · 0 comments