deepanwadhwa/samosa-chat
View on GitHub ↗ ★ 55 JavaScript
Run large models like Qwen3.6-35B-A3B locally on a 16 GB RAM machine
6 mentions on Hacker News by 3 people: 1 story, 5 comments · first 2026-07-15 · latest 2026-09-01
20082026
-
…tokens/sec with all the optimizations while keeping the peak memory and thermal warnings at check. https://github.com/deepanwadhwa/samosa-chat
comment by prometheus1992 · 2026-09-01 · in Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s -
Can't wait to try this. Ornith1 (9B) was a really nice model. I have been running it locally using - https://github.com/deepanwadhwa/samosa-chat
comment by prometheus1992 · 2026-08-19 · in Ornith-1.5: From Self-Scaffolding to Self-Improvement -
> I am running Qwen3.6-35B-A3B locally on my 16GB mac with 7-9 tokens/second. Link - https://github.com/deepanwadhwa/samosa-chat It's quite telling you didn't use Qwen3.6-35B-A3B locally to build that, seems there was another collaborator…
comment by embedding-shape · 2026-07-15 · in Running Gemma 4 26B at 5 tokens/sec on a 13-year-old Xeon with no GPU -
…hardware. I am running Qwen3.6-35B-A3B locally on my 16GB mac with 7-9 tokens/second. Link - https://github.com/deepanwadhwa/samosa-chat This is a GPT4 level model running locally with a decent speed on a 16gb ram macbook air.
comment by dwa3592 · 2026-07-15 · in Running Gemma 4 26B at 5 tokens/sec on a 13-year-old Xeon with no GPU -
…This is one of the important reasons for creating this - no excessive wear/tear to the machine. https://github.com/deepanwadhwa/samosa-chat#the-three-princi... maybe give it a try and let me know if your macbook is getting heated while…
comment by dwa3592 · 2026-07-15 · in Show HN: Samosa Chat - Run Qwen3.6-35B-A3B Locally on a 16 GB Mac