mmastrac/diffgemma
View on GitHub ↗ ★ 37 Rust
A pure Rust implementation of Google's DiffusionGemma model
6 mentions on Hacker News by 1 person: 0 stories, 6 comments · first 2026-07-29 · latest 2026-09-10
20082026
-
…tokens for $22.04 USD for the last couple of days. Kind of shocked. It did a decent job refactoring https://github.com/mmastrac/diffgemma to create a CUDA support backbone, it's struggling a bit to port metal kernels to CUDA unattended (it…
comment by mmastrac · 2026-09-10 · in DeepSeek v4.1 Flash -
https://github.com/mmastrac/diffgemma#custom-quantization has some instructions on (naively) quantizing the upstream model as well.
comment by mmastrac · 2026-09-08 · in OUI-1: world's first model for Generative UI -
It should be possible to run on Mac via https://github.com/mmastrac/diffgemma , but I'm at rustconf right now and I can't download weights on hotel wifi easily.
comment by mmastrac · 2026-09-08 · in OUI-1: world's first model for Generative UI -
I re-implemented this one for macOS over the last couple of months: https://github.com/mmastrac/diffgemma I like the model a lot and it's fairly good at reasoning. You can also really bend it to your needs. It's designed for machines with…
comment by mmastrac · 2026-08-20 · in DiffusionGemma Technical Report -
…of time to deslop. I've spend a nonzero amount of time on refactoring and comment-vomit cleanup. https://github.com/mmastrac/diffgemma
comment by mmastrac · 2026-08-07 · in Inside vLLM: Anatomy of a High-Throughput LLM Inference System (2025) -
…we might be able to crib faster kernels from each other. Feel free to reach out. (currently at https://github.com/mmastrac/diffgemma but not in a releasable state yet)
comment by mmastrac · 2026-07-29 · in Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac