databricks/megablocks

View on GitHub ↗ ★ 1,598 Python archived

3 mentions on Hacker News by 3 people: 1 story, 2 comments · first 2023-01-27 · latest 2023-12-08

Mentions per year 3 mentions · busiest year 2023 (3)

20082026

All Stories Comments Newest Top Oldest

This is a fork of https://github.com/stanford-futuredata/megablocks should link to the original when possible, per HN posting guidelines
comment by verdverm · 2023-12-08 · in Mistral: Light-weight library for mixture-of-experts (MoE) training
Mixtral-8x7B support --> Support new model https://github.com/stanford-futuredata/megablocks/pull/45
comment by cloudhan · 2023-12-08 · in Mistral "Mixtral" 8x7B 32k model [magnet]