Hacker GitHub

← All repos

JustVugg/colibri

View on GitHub ↗ ★ 46,125 C

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

18 mentions on Hacker News by 16 people: 3 stories, 15 comments · first 2026-07-09 · latest 2026-09-21

Mentions per year 18 mentions · busiest year 2026 (18)
20082026
AllStoriesComments NewestTopOldest
  1. Colibri did that first for GLM-5.2 https://github.com/JustVugg/colibri
    comment by kzrdude · 2026-09-02 · in Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s
  2. …and stream the rest from a fast NVMe SSD for acceptable performance similar to how Colibri works? https://github.com/JustVugg/colibri
    comment by yonatan8070 · 2026-08-26 · in GLM-5.3-Flash
  3. This is interesting. I wonder how it could work with something like https://github.com/JustVugg/colibri .
    comment by akshay_akula · 2026-08-19 · in Show HN: Shoehorn – Quantize any model down to run on your machine
  4. …that qualifies as local, but it's at least not a rack. [1] https://github.com/antirez/ds4 [2] https://github.com/JustVugg/colibri
    comment by wren6991 · 2026-08-14 · in GLM-5.3: Frontier coding with emergent cyber capabilities
  5. Check for colibri, dwarf star and flash-moe. they do similar things with bigger models https://github.com/JustVugg/colibri https://github.com/antirez/ds4 https://github.com/danveloper/flash-moe
    comment by gitpusher42 · 2026-07-29 · in Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac
  6. …Colibri and Flash-MoE projects. They’re already doing that. https://github.com/danveloper/flash-moe https://github.com/JustVugg/colibri
    comment by gitpusher42 · 2026-07-29 · in Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac
  7. …local we might get good coverage for decent usage, granted each one is specialized enough. [1] : https://github.com/JustVugg/colibri [2] : https://fireworks.ai/blog/kimik3-fable
    comment by maxignol · 2026-07-29 · in Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac
  8. …to allow running GLM 5.2 the 744B model in 32GB by using prefetches and streaming from fast SSDs. https://github.com/JustVugg/colibri
    comment by EarthMephit · 2026-07-27 · in Chinese chipmaker shares surge 470%
  9. …Or from SSD using something like Colibri[1]. Not going to be quick, but at least runable. [1]: https://github.com/JustVugg/colibri
    comment by magicalhippo · 2026-07-27 · in Kimi-K3 on HuggingFace
  10. …right tools. I'm aware of colibri [1], but so far I've only seen extremely slow performance. [1] https://github.com/JustVugg/colibri
    comment by docheinestages · 2026-07-27 · in Kimi-K3 on HuggingFace
  11. …per token_ (not tokens per second). EDIT: it was 25GB of ram and up to 20 seconds per token! https://github.com/JustVugg/colibri
    comment by AussieWog93 · 2026-07-26 · in Running a 28.9M parameter LLM on an $8 microcontroller
  12. …On a machine with 32GB ram, and NO gpu. Just need a large SSD or NVME. Streams from disk to memory. https://github.com/JustVugg/colibri
    comment by nekusar · 2026-07-21 · in Who's afraid of Chinese models?
  13. If you’re interested in these projects you should check out the project this was based on: https://github.com/JustVugg/colibri It says so right in the readme. They’re not hiding anything.
    comment by Aurornis · 2026-07-15 · in Running Gemma 4 26B at 5 tokens/sec on a 13-year-old Xeon with no GPU
  14. …the possible early burnout of their storage? They must use external storage as the burner SSD. [0] https://github.com/JustVugg/colibri#ssd-wear-warning
    comment by voidmain0001 · 2026-07-09 · in Show HN: Getting GLM 5.2 running on my slow computer
  15. README covers that https://github.com/JustVugg/colibri#ssd-wear-warning
    comment by xfalcox · 2026-07-09 · in Show HN: Getting GLM 5.2 running on my slow computer