GeeeekExplorer/nano-vllm
View on GitHub ↗ ★ 16,360 Python
Nano vLLM
7 mentions on Hacker News by 7 people: 3 stories, 4 comments · first 2025-06-16 · latest 2026-08-06
20082026
-
…due to its codebase size, but contains all the major pieces that make an inference engine fast. [1] https://github.com/GeeeekExplorer/nano-vllm
comment by miki123211 · 2026-08-06 · in Inside vLLM: Anatomy of a High-Throughput LLM Inference System (2025) -
…and after 6 hours, It suddenly clicked about something new. I had seen this project on reddit once, https://github.com/GeeeekExplorer/nano-vllm It's almost as fast (from what I can tell in its readme, faster?) than vllm itself but…
comment by Imustaskforhelp · 2026-01-29 · in LM Studio 0.4 -
did you see yesterday nano-vllm [1] from a deepseek employee 1200LOC and faster than vanilla vllm? 1. https://github.com/GeeeekExplorer/nano-vllm
comment by tough · 2025-06-24 · in Basic Facts about GPUs -
…space. I tried to implement this in @vllm_project, but it was a bit too heavy for me to figure out. https://github.com/GeeeekExplorer/nano-vllm/pull/34
comment by jimmySixDOF · 2025-06-23 · in Nano-Vllm: Lightweight vLLM implementation built from scratch