jmaczan/tiny-vllm
View on GitHub ↗ ★ 1,185 C++
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
6 mentions on Hacker News by 1 person: 2 stories, 4 comments · first 2026-03-09 · latest 2026-08-07
20082026
-
▲ 2
AMD contributes their GPU support to tiny-vLLMstory by yu3zhou4 · 2026-06-29 · 0 comments
-
▲ 205
Show HN: Tiny-vLLM – high performance LLM inference engine in C++ and CUDAstory by yu3zhou4 · 2026-05-29 · 18 comments