ai-dynamo/dynamo
View on GitHub ↗ ★ 8,470 Rust
A Datacenter Scale Distributed Inference Serving Framework
3 mentions on Hacker News by 3 people: 1 story, 2 comments · first 2025-03-18 · latest 2025-05-20
20082026
-
I would think that that the NVidia Dynamo SDK (pipelines) is a big difference as well ( https://github.com/ai-dynamo/dynamo/tree/main/deploy/sdk/doc... ), or am I missing something?
comment by rdli · 2025-05-20 · in LLM-D: Kubernetes-Native Distributed Inference -
They kind of are, but not in CUDA directly. https://github.com/ai-dynamo/dynamo > NVIDIA Dynamo is a high-throughput low-latency inference framework designed for serving generative AI and reasoning models in multi-node distributed…
comment by pjmlp · 2025-04-11 · in Rust CUDA Project