FlashML-org/FreeToken
View on GitHub ↗ ★ 16,986 Python
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
4 mentions on Hacker News by 4 people: 1 story, 3 comments · first 2026-08-21 · latest 2026-11-02
20082026
-
Source: https://github.com/FlashML-org/FreeToken > FreeToken is an edge-native Mixture-of-Experts (MoE) serving engine designed for running frontier-scale open-weight models on personal and consumer hardware. It treats heterogeneous edge…
comment by lioeters · 2026-11-02 · in FreeToken: Datacenter-class intelligence on the hardware you own -
I had this working with the FreeToken inference engine a month ago when they launched. https://github.com/FlashML-org/FreeToken
comment by gdevenyi · 2026-10-04 · in Run Qwen 3.8 Flash Next (125B) on consumer hardware (RTX 4090) at 100T/s -
…locally at good speeds is a used 3090 and some DDR4, then we might be in for the year of local AI. https://github.com/FlashML-org/FreeToken
comment by notnullorvoid · 2026-08-25 · in Qwen 3.8-Flash-Next releasing tomorrow (125B a6B)