Michael-A-Kuykendall/shimmy
View on GitHub ↗ ★ 6,015 Rust
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
6 mentions on Hacker News by 1 person: 3 stories, 3 comments · first 2025-09-04 · latest 2025-10-09
20082026
-
▲ 3
Shimmy v1.7.0: Running 42B Moe Models on Consumer GPUs with 99.9% VRAM Reductionstory by MKuykendall · 2025-10-09 · 1 comment
-
▲ 2
Show HN: 5MB Rust binary that runs HuggingFace models (no Python)story by MKuykendall · 2025-09-10 · 2 comments
-
▲ 14
Show HN: Shimmy – 5MB privacy-first, local alternative to Ollama (680MB)story by MKuykendall · 2025-09-04 · 13 comments