kuleshov/minillm
View on GitHub ↗ ★ 978 Python
MiniLLM is a minimal system for running modern LLMs on consumer-grade GPUs
5 mentions on Hacker News by 3 people: 2 stories, 3 comments · first 2023-03-16 · latest 2023-04-30
20082026
-
▲ 1
MiniLLM is a minimal system for running modern LLMs on consumer-grade GPUsstory by tosh · 2023-04-30 · 0 comments
-
▲ 3
Don't have a $5k MacBook to run LLAMA65B? MiniLLM runs LLMs on GPUs in <500 LOCstory by volodia · 2023-03-18 · 2 comments