Hacker GitHub

← All repos

drumih/turbo-fieldfare

View on GitHub ↗ ★ 7,324 Swift

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

5 mentions on Hacker News by 3 people: 1 story, 4 comments · first 2026-07-29 · latest 2026-08-25

Mentions per year 5 mentions · busiest year 2026 (5)
20082026
  1. …are really reducing the memory requirements to run large models and I don’t see it stopping soon. https://github.com/drumih/turbo-fieldfare
    comment by twobitshifter · 2026-08-25 · in Apple introduces M6 and M5 Ultra
  2. …then reading it off there and into memory. All of these run perfectly fine on simple m4 silicone: https://github.com/drumih/turbo-fieldfare https://github.com/leonickson1/Swiftlet https://github.com/sqliteai/warp
    comment by literoldolphin · 2026-08-14 · in Qwen 3.8 27B
  3. Yeah, original TurboFieldfare supports Gemma https://github.com/drumih/turbo-fieldfare
  4. …response back to the array. `/reset` can clear it There is a python example in the server docs. ( https://github.com/drumih/turbo-fieldfare/blob/main/docs/OPE... ) It is non-streaming, but can be used as a starting point. The server is…