Anemll/flash-moe
View on GitHub ↗ ★ 229 Objective-C
3 mentions on Hacker News by 3 people: 0 stories, 3 comments · first 2026-03-23 · latest 2026-03-23
20082026
-
Check my repo, I had added some support for GUFF/untloth, Q3,Q5/Q8 https://github.com/Anemll/flash-moe/blob/iOS-App/docs/gguf-h...
comment by anemll · 2026-03-23 · in iPhone 17 Pro Demonstrated Running a 400B LLM -
…mac somehow easily? Or this requires custom coding? 4bit is ~200GB EDIT: found this in the replies: https://github.com/Anemll/flash-moe/tree/iOS-App
comment by thecopy · 2026-03-23 · in iPhone 17 Pro Demonstrated Running a 400B LLM -
Looks like it's Qwen3.5-397B-A17B so 17B active. https://github.com/Anemll/flash-moe/tree/iOS-App
comment by simonw · 2026-03-23 · in iPhone 17 Pro Demonstrated Running a 400B LLM