dvmazur/mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops

3 mentions on Hacker News by 3 people: 2 stories, 1 comment · first 2024-01-01 · latest 2024-03-27

Mentions per year 3 mentions · busiest year 2024 (3)

20082026

All Stories Comments Newest Top Oldest

…10 GB VRAM rtx3080... This should work for DBRX and should shave off a ton of VRAM requirement. 1. https://github.com/dvmazur/mixtral-offloading?tab=readme-ov-...
comment by underlines · 2024-03-27 · in DBRX: A new open LLM