← All repos

noonghunna/club-3090

View on GitHub ↗ ★ 2,471 Python

Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and model-agnostic. Currently shipping Qwen3.8-27B Qwen3.6 35B Gemma 4 26B Gemma 4 31B configs for 1×/2×/4x/8x cards.

12 mentions on Hacker News by 11 people: 1 story, 11 comments · first 2026-04-30 · latest 2026-10-02