Hacker GitHub

← All repos

kuleshov/minillm

View on GitHub ↗ ★ 978 Python

MiniLLM is a minimal system for running modern LLMs on consumer-grade GPUs

5 mentions on Hacker News by 3 people: 2 stories, 3 comments · first 2023-03-16 · latest 2023-04-30

Mentions per year 5 mentions · busiest year 2023 (5)
20082026
AllStoriesComments NewestTopOldest
  1. ▲ 1
    MiniLLM is a minimal system for running modern LLMs on consumer-grade GPUs
    story by tosh · 2023-04-30 · 0 comments
  2. ▲ 3
    Don't have a $5k MacBook to run LLAMA65B? MiniLLM runs LLMs on GPUs in <500 LOC
    story by volodia · 2023-03-18 · 2 comments
  3. There are also equally easy to use open source systems, check out this one for example: https://github.com/kuleshov/minillm
    comment by volodia · 2023-03-18 · in TextSynth Server
  4. Try this: it installs with a simple python command if you have an NVIDIA GPU: https://github.com/kuleshov/minillm
    comment by volodia · 2023-03-18 · in Load LLaMA Models Instantly
  5. GitHub link: https://github.com/kuleshov/minillm
    comment by 22c · 2023-03-16 · in MiniLLM: A minimal system for running LLMs on consumer-grade Nvidia GPUs