geisten/geistlib
View on GitHub ↗ ★ 3 C
Tiny dependency-free C23 inference engine for small LLMs — ternary BitNet, CPU-first, runs on a Raspberry Pi
3 mentions on Hacker News by 1 person: 2 stories, 1 comment · first 2026-08-05 · latest 2026-08-11
20082026
-
▲ 1
I wrote a C inference engine that runs BitNet 2B at 15–18 tok/s on a Pi 5story by geisten · 2026-08-11 · 1 comment
-
▲ 1
Microsoft's BitNet 2B on a 4 GB Raspberry Pi 5, in one 1.2 GB filestory by geisten · 2026-08-05 · 0 comments