kvcache-ai/Mooncake
View on GitHub ↗ ★ 7,025 C++
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
3 mentions on Hacker News by 3 people: 1 story, 2 comments · first 2024-06-29 · latest 2025-10-15
20082026
-
…VRAM directly from NVMe SSD without it having to go through the host's regular CPU and RAM first! https://github.com/kvcache-ai/Mooncake/blob/main/doc/en/tran... > Transfer Engine also leverages the NVMeof protocol to support direct data…
comment by simonw · 2025-10-15 · in Claude Haiku 4.5 -
…often with pluggable backends. A popular open-source backend for the "slow" tier is Mooncake: https://github.com/kvcache-ai/Mooncake
comment by tazjin · 2025-10-15 · in Claude Haiku 4.5