leonickson1/Swiftlet
View on GitHub ↗ ★ 668 Swift
Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights from storage, enabling 35B and 80B models to run with low RAM, including on iPhone.
3 mentions on Hacker News by 3 people: 1 story, 2 comments · first 2026-08-03 · latest 2026-08-14
20082026
-
▲ 312
Show HN: Run an 80B Qwen in 4.3 GB of RAM on a Mac, and a 35B on an iPhonestory by leonickson · 2026-08-03 · 141 comments