Hacker GitHub

← All repos

danveloper/flash-moe

View on GitHub ↗ ★ 4,469 Objective-C

Running a big model on a small laptop

8 mentions on Hacker News by 6 people: 1 story, 7 comments · first 2026-03-22 · latest 2026-07-29

Mentions per year 8 mentions · busiest year 2026 (8)
20082026
AllStoriesComments NewestTopOldest
  1. …things with bigger models https://github.com/JustVugg/colibri https://github.com/antirez/ds4 https://github.com/danveloper/flash-moe
    comment by gitpusher42 · 2026-07-29 · in Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac
  2. Yeah! Check the Colibri and Flash-MoE projects. They’re already doing that. https://github.com/danveloper/flash-moe https://github.com/JustVugg/colibri
    comment by gitpusher42 · 2026-07-29 · in Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac
  3. I think I first saw Flash-MoE ( https://github.com/danveloper/flash-moe ) in April. Huge respect to them, it was a big inspiration for this project!
    comment by gitpusher42 · 2026-07-29 · in Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac
  4. Another recent project that runs a huge model on a 48gb Mac is https://github.com/danveloper/flash-moe - it gets over 5 tokens/sec on an M3 Max compared to this projects very impressive 1 token/sec on an M5 Max. So for anyone wanting to…
    comment by bahmboo · 2026-07-09 · in Show HN: Getting GLM 5.2 running on my slow computer
  5. …the Flash-MoE[2] integration to be even better soon as well. [1] https://apfel.franzai.com/ [2] https://github.com/danveloper/flash-moe
    comment by gibsonsmog · 2026-04-27 · in GitHub Copilot is moving to usage-based billing
  6. …two that I starred when I saw them posted here. I have not looked seriously at it at the moment, https://github.com/danveloper/flash-moe https://github.com/t8/hypura
    comment by inventor7777 · 2026-04-24 · in DeepSeek v4
  7. …a reference project, the main different is we don't use os swap ( it introduces latency, will add https://github.com/danveloper/flash-moe to the original reference as well ).
    comment by aegis_camera · 2026-04-01 · in TurboQuant KV Compression and SSD Expert Streaming for M5 Pro and IOS
  8. ▲ 398
    Flash-MoE: Running a 397B Parameter Model on a Laptop
    story by mft_ · 2026-03-22 · 119 comments