drumih/turbo-fieldfare
View on GitHub ↗ ★ 7,324 Swift
Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
5 mentions on Hacker News by 3 people: 1 story, 4 comments · first 2026-07-29 · latest 2026-08-25
20082026
-
…are really reducing the memory requirements to run large models and I don’t see it stopping soon. https://github.com/drumih/turbo-fieldfare
comment by twobitshifter · 2026-08-25 · in Apple introduces M6 and M5 Ultra -
…then reading it off there and into memory. All of these run perfectly fine on simple m4 silicone: https://github.com/drumih/turbo-fieldfare https://github.com/leonickson1/Swiftlet https://github.com/sqliteai/warp
comment by literoldolphin · 2026-08-14 · in Qwen 3.8 27B -
Yeah, original TurboFieldfare supports Gemma https://github.com/drumih/turbo-fieldfare
comment by gitpusher42 · 2026-08-04 · in Show HN: Run an 80B Qwen in 4.3 GB of RAM on a Mac, and a 35B on an iPhone -
…response back to the array. `/reset` can clear it There is a python example in the server docs. ( https://github.com/drumih/turbo-fieldfare/blob/main/docs/OPE... ) It is non-streaming, but can be used as a starting point. The server is…
comment by gitpusher42 · 2026-08-01 · in Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac