JustVugg/colibri
View on GitHub ↗ ★ 46,125 C
Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
18 mentions on Hacker News by 16 people: 3 stories, 15 comments · first 2026-07-09 · latest 2026-09-21
20082026
-
▲ 1
Brio mode in Colibri: Scoring a closed set instead of generatingstory by vforno · 2026-09-21 · 1 comment
-
Colibri did that first for GLM-5.2 https://github.com/JustVugg/colibri
comment by kzrdude · 2026-09-02 · in Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s -
…and stream the rest from a fast NVMe SSD for acceptable performance similar to how Colibri works? https://github.com/JustVugg/colibri
comment by yonatan8070 · 2026-08-26 · in GLM-5.3-Flash -
This is interesting. I wonder how it could work with something like https://github.com/JustVugg/colibri .
comment by akshay_akula · 2026-08-19 · in Show HN: Shoehorn – Quantize any model down to run on your machine -
…that qualifies as local, but it's at least not a rack. [1] https://github.com/antirez/ds4 [2] https://github.com/JustVugg/colibri
comment by wren6991 · 2026-08-14 · in GLM-5.3: Frontier coding with emergent cyber capabilities -
▲ 1
Call for probes: building the GLM-5.2 Expert Atlasstory by Bluestein · 2026-08-11 · 0 comments
-
Check for colibri, dwarf star and flash-moe. they do similar things with bigger models https://github.com/JustVugg/colibri https://github.com/antirez/ds4 https://github.com/danveloper/flash-moe
comment by gitpusher42 · 2026-07-29 · in Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac -
…Colibri and Flash-MoE projects. They’re already doing that. https://github.com/danveloper/flash-moe https://github.com/JustVugg/colibri
comment by gitpusher42 · 2026-07-29 · in Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac -
…local we might get good coverage for decent usage, granted each one is specialized enough. [1] : https://github.com/JustVugg/colibri [2] : https://fireworks.ai/blog/kimik3-fable
comment by maxignol · 2026-07-29 · in Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac -
…to allow running GLM 5.2 the 744B model in 32GB by using prefetches and streaming from fast SSDs. https://github.com/JustVugg/colibri
comment by EarthMephit · 2026-07-27 · in Chinese chipmaker shares surge 470% -
…Or from SSD using something like Colibri[1]. Not going to be quick, but at least runable. [1]: https://github.com/JustVugg/colibri
comment by magicalhippo · 2026-07-27 · in Kimi-K3 on HuggingFace -
…right tools. I'm aware of colibri [1], but so far I've only seen extremely slow performance. [1] https://github.com/JustVugg/colibri
comment by docheinestages · 2026-07-27 · in Kimi-K3 on HuggingFace -
…per token_ (not tokens per second). EDIT: it was 25GB of ram and up to 20 seconds per token! https://github.com/JustVugg/colibri
comment by AussieWog93 · 2026-07-26 · in Running a 28.9M parameter LLM on an $8 microcontroller -
…On a machine with 32GB ram, and NO gpu. Just need a large SSD or NVME. Streams from disk to memory. https://github.com/JustVugg/colibri
comment by nekusar · 2026-07-21 · in Who's afraid of Chinese models? -
If you’re interested in these projects you should check out the project this was based on: https://github.com/JustVugg/colibri It says so right in the readme. They’re not hiding anything.
comment by Aurornis · 2026-07-15 · in Running Gemma 4 26B at 5 tokens/sec on a 13-year-old Xeon with no GPU -
…the possible early burnout of their storage? They must use external storage as the burner SSD. [0] https://github.com/JustVugg/colibri#ssd-wear-warning
comment by voidmain0001 · 2026-07-09 · in Show HN: Getting GLM 5.2 running on my slow computer -
README covers that https://github.com/JustVugg/colibri#ssd-wear-warning
comment by xfalcox · 2026-07-09 · in Show HN: Getting GLM 5.2 running on my slow computer -
▲ 937
Show HN: Getting GLM 5.2 running on my slow computerstory by vforno · 2026-07-09 · 240 comments