Hacker GitHub

← All repos

Helldez/BigMoeOnEdge

View on GitHub ↗ ★ 740 C++

Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

4 mentions on Hacker News by 4 people: 2 stories, 2 comments · first 2026-07-19 · latest 2026-10-20

Mentions per year 4 mentions · busiest year 2026 (4)
20082026
AllStoriesComments NewestTopOldest
  1. ▲ 1
    Show HN: A layer on top llama.cpp enabling big MoE streaming on phone and laptop
    story by HelldezNoBan · 2026-10-20 · 0 comments
  2. ▲ 1
    Show HN: Run a 120B-parameter MoE on Android mid-range phone CPU-only llama.cpp
    story by Helldez · 2026-07-19 · 0 comments