vllm-project/vllm
View on GitHub ↗ ★ 96,122 Python
A high-throughput and memory-efficient inference and serving engine for LLMs
67 mentions on Hacker News by 51 people: 16 stories, 51 comments · first 2023-06-25 · latest 2026-09-26
20082026
-
▲ 1
vLLM: Jev-like mode for the DiffusionGemma modelstory by mmastrac · 2026-09-16 · 0 comments
-
▲ 3
vLLM 0.29.0: Model Runner V2 is now the defaultstory by joshcsimmons · 2026-09-09 · 0 comments
-
▲ 108
vLLM v0.28.0story by mrrrcs · 2026-08-29 · 43 comments
-
▲ 4
vLLM IR: A Functional Intermediate Representation for vLLMstory by matt_d · 2026-04-07 · 0 comments
-
▲ 5
vLLM introduces memory optimizations for long-context inferencestory by addisud · 2026-04-04 · 0 comments
-
▲ 2
vLLM (high-throughput LLM serving engine)story by roody_wurlitzer · 2026-02-25 · 0 comments
-
▲ 1
vLLM multi-turn conversations designstory by CCs · 2026-01-22 · 0 comments
-
▲ 1
VLLM Sacrifices Accuracy for Speedstory by behnamoh · 2024-01-24 · 0 comments
-
▲ 2
Easy, fast, and cheap LLM serving for everyonestory by vincent_s · 2023-12-17 · 0 comments
-
▲ 1
vllmstory by tosh · 2023-12-15 · 0 comments
-
▲ 1
Mixtral Expert Parallelismstory by tosh · 2023-12-15 · 0 comments
-
▲ 2
Official PR Reveals the Inference Code for Mixtral 8x7Bstory by georgehill · 2023-12-11 · 0 comments
-
▲ 3
Vllm: High-throughput and memory-efficient inference and serving engine for LLMsstory by tosh · 2023-09-10 · 0 comments
-
▲ 15
Ask HN: Are you training and running custom LLMs and how are you doing it?story by kordlessagain · 2023-08-14 · 2 comments
-
▲ 3
Vllmstory by kordlessagain · 2023-08-06 · 0 comments
-
▲ 2
VLLMstory by sherlockxu · 2023-06-25 · 0 comments