Hacker GitHub

← All repos

noonghunna/club-3090

View on GitHub ↗ ★ 2,471 Python

Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and model-agnostic. Currently shipping Qwen3.8-27B Qwen3.6 35B Gemma 4 26B Gemma 4 31B configs for 1×/2×/4x/8x cards.

12 mentions on Hacker News by 11 people: 1 story, 11 comments · first 2026-04-30 · latest 2026-10-02

Mentions per year 12 mentions · busiest year 2026 (12)
20082026
AllStoriesComments NewestTopOldest
  1. …not long ago and can't really believe we've got our hands on a x090 series targeting Qwen3.8 27b, https://github.com/noonghunna/club-3090 is the way to go. I'm maintaining a web frontend for this, trying to at least. You can follow it…
    comment by gchamonlive · 2026-10-02 · in From the creator of Redis; run LLM locally with ds4
  2. …get to >100tps on my dual 3090s qwen 3.5 27b was running at around 110tps using the config from https://github.com/noonghunna/club-3090 make that 200tps on a single 5090, 4x faster than opus https://x.com/radixark/status/2088285681131110446…
    comment by m_ke · 2026-08-14 · in Qwen 3.8 27B
  3. you should look into https://github.com/noonghunna/club-3090
    comment by xiconfjs · 2026-07-20 · in Qwen 3.8
  4. There's a sub 2k tier with a single 3090 that's also serviceable. Run https://github.com/noonghunna/club-3090 with beellama, fast inference at the cost of a reduced 102k context window
    comment by gchamonlive · 2026-07-03 · in Jamesob's guide to running SOTA LLMs locally
  5. …setups are fairly popular as well. I've heard that club 3090 makes that relatively straightforward https://github.com/noonghunna/club-3090 but don't have experience myself.
    comment by mswphd · 2026-07-02 · in Kimi K2.7 Code is generally available in GitHub Copilot
  6. …Have a look at this repo with single/double 3090 optimized configs for Qwen and Gema models: https://github.com/noonghunna/club-3090
    comment by nsbk · 2026-06-29 · in Qwen 3.6 27B is the sweet spot for local development
  7. This is a good place to start reading about dual gpus. https://github.com/noonghunna/club-3090/blob/master/docs/DUA...
    comment by xrd · 2026-06-23 · in GLM-5.2 – How to Run Locally
  8. …today, with building a server, I'd jump right into verified set-ups and writeups, like this one: https://github.com/noonghunna/club-3090 You can find info about running a patched version of vllm for 1x24gb, 2x and 4x. There's also quite a…
    comment by eurekin · 2026-06-18 · in Local Qwen isn't a worse Opus, it's a different tool
  9. …to run it. Qwen3.6 27b has been rock solid using club 3090's single card setup for agentic use -- https://github.com/noonghunna/club-3090/blob/master/docs/SIN...
    comment by dstryr · 2026-06-16 · in Running local models is good now
  10. …and r/LocalLLaMA/ are worth a visit IMO. EDIT: just found this recipe repo, may wanna give it a go: https://github.com/noonghunna/club-3090 EDIT-2: this can also shave off a lot of context need for tool calling ->…
    comment by pferdone · 2026-05-07 · in ZAYA1-8B matches DeepSeek-R1 on math with less than 1B active parameters
  11. ▲ 1
    Club-3090 Recipes for serving QWEN3.6 27B locally on RTX 3090s
    story by lastdong · 2026-05-05 · 0 comments
  12. I run it with Llama.cpp on my RTX 3090. Also using the same Unsloth model. My config is similar to: https://github.com/noonghunna/club-3090/blob/master/docs/eng... I need to try out some of the other set ups mentioned in this repo for…
    comment by jyap · 2026-04-30 · in Granite 4.1: IBM's 8B Model Matching 32B MoE