geisten/geistlib
View on GitHub ↗ ★ 3 C
Tiny dependency-free C23 inference engine for small LLMs — ternary BitNet, CPU-first, runs on a Raspberry Pi
3 mentions on Hacker News by 1 person: 2 stories, 1 comment · first 2026-08-05 · latest 2026-08-11
20082026
-
…executable containing both the engine and the model. Install and run: ``` curl -L -o geist-bitnet https://github.com/geisten/geistlib/releases/latest/download... chmod +x geist-bitnet ./geist-bitnet "The three largest moons of Jupiter are"…
comment by geisten · 2026-08-11 · in I wrote a C inference engine that runs BitNet 2B at 15–18 tok/s on a Pi 5 -
▲ 1
I wrote a C inference engine that runs BitNet 2B at 15–18 tok/s on a Pi 5story by geisten · 2026-08-11 · 1 comment
-
▲ 1
Microsoft's BitNet 2B on a 4 GB Raspberry Pi 5, in one 1.2 GB filestory by geisten · 2026-08-05 · 0 comments