peonist-ai/halogen-flash-server
View on GitHub ↗ ★ 1,300 Shell
Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.
3 mentions on Hacker News by 3 people: 1 story, 2 comments · first 2026-09-18 · latest 2026-09-30
20082026
-
if you haven't tried Qwen3.8-Flash-Next with halogen, you're missing out: https://github.com/peonist-ai/halogen-flash-server#the-host-...
comment by cyanydeez · 2026-09-30 · in Gemini 4 Argon -
Halogen as in this right? https://github.com/peonist-ai/halogen-flash-server
comment by syntaxing · 2026-09-18 · in Shapelearn Qwen 3.8 27B (13.1 GB VRAM)