leonickson1/Swiftlet
View on GitHub ↗ ★ 668 Swift
Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights from storage, enabling 35B and 80B models to run with low RAM, including on iPhone.
3 mentions on Hacker News by 3 people: 1 story, 2 comments · first 2026-08-03 · latest 2026-08-14
20082026
-
…All of these run perfectly fine on simple m4 silicone: https://github.com/drumih/turbo-fieldfare https://github.com/leonickson1/Swiftlet https://github.com/sqliteai/warp
comment by literoldolphin · 2026-08-14 · in Qwen 3.8 27B -
That line was authored by Claude. There you go: https://github.com/leonickson1/Swiftlet/commit/3ac64020eadcb...
comment by tredre3 · 2026-08-04 · in Show HN: Run an 80B Qwen in 4.3 GB of RAM on a Mac, and a 35B on an iPhone