Hacker GitHub

← All repos

kuleshov/minillm

View on GitHub ↗ ★ 978 Python

MiniLLM is a minimal system for running modern LLMs on consumer-grade GPUs

5 mentions on Hacker News by 3 people: 2 stories, 3 comments · first 2023-03-16 · latest 2023-04-30

Mentions per year 5 mentions · busiest year 2023 (5)
20082026
AllStoriesComments NewestTopOldest
  1. There are also equally easy to use open source systems, check out this one for example: https://github.com/kuleshov/minillm
    comment by volodia · 2023-03-18 · in TextSynth Server
  2. Try this: it installs with a simple python command if you have an NVIDIA GPU: https://github.com/kuleshov/minillm
    comment by volodia · 2023-03-18 · in Load LLaMA Models Instantly
  3. GitHub link: https://github.com/kuleshov/minillm
    comment by 22c · 2023-03-16 · in MiniLLM: A minimal system for running LLMs on consumer-grade Nvidia GPUs