Hacker GitHub

← All repos

kvcache-ai/Mooncake

View on GitHub ↗ ★ 7,025 C++

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

3 mentions on Hacker News by 3 people: 1 story, 2 comments · first 2024-06-29 · latest 2025-10-15

Mentions per year 3 mentions · busiest year 2025 (2)
20082026
AllStoriesComments NewestTopOldest
  1. …VRAM directly from NVMe SSD without it having to go through the host's regular CPU and RAM first! https://github.com/kvcache-ai/Mooncake/blob/main/doc/en/tran... > Transfer Engine also leverages the NVMeof protocol to support direct data…
    comment by simonw · 2025-10-15 · in Claude Haiku 4.5
  2. …often with pluggable backends. A popular open-source backend for the "slow" tier is Mooncake: https://github.com/kvcache-ai/Mooncake
    comment by tazjin · 2025-10-15 · in Claude Haiku 4.5
  3. ▲ 13
    Mooncake: A KVCache-Centric Disaggregated Architecture for LLM Serving
    story by zinccat · 2024-06-29 · 0 comments