JThomas-CoE/College-of-Experts-AI
View on GitHub ↗ ★ 6 Python
A framework decomposing large MoE models into disk-resident specialist networks for consumer hardware. Run SOTA-class ensembles locally on limited VRAM by dynamically loading experts. Proof of concept showed +27% benchmark gain over isolated models.
3 mentions on Hacker News by 1 person: 1 story, 2 comments · first 2026-03-11 · latest 2026-04-16
20082026
-
▲ 3
Slicing an 80B MoE LLM into 40B domain specialistsstory by JThomas-CoE · 2026-03-11 · 1 comment