cloudrift-ai/emmy
View on GitHub ↗ ★ 123 Python
Optimized GPU compiler for LLM inference. Choose from a list of optimized recipes or optimize your own model via kernel fusion, autotuning, and advanced scheduling. Run benchmarks across different GPU types and configurations, track results and share experiments with the community.
3 mentions on Hacker News by 1 person: 0 stories, 3 comments · first 2026-07-28 · latest 2026-08-06
20082026
-
…all GEMM and Attention kernels used in the model rather than requiring hand optimization. Repo: https://github.com/cloudrift-ai/emmy
comment by gkapur · 2026-08-06 -
…introduce both of these optimizations into all GEMM and Attention kernels used in the model. Repo: https://github.com/cloudrift-ai/emmy
comment by gkapur · 2026-08-05 -
…memory-bound story where split-KV/Flash-Decoding matters more than any of the above. Github: https://github.com/cloudrift-ai/emmy
comment by gkapur · 2026-07-28 · in Exploring FlashAttention-3/4 optimizations on RTX GPUs