Hacker GitHub

← All repos

simonw/llm-mlc

View on GitHub ↗ ★ 193 Python

LLM plugin for running models using MLC

3 mentions on Hacker News by 2 people: 0 stories, 3 comments · first 2023-08-15 · latest 2023-09-05

Mentions per year 3 mentions · busiest year 2023 (3)
20082026
AllStoriesComments NewestTopOldest
  1. …of them. Here's some relevant code: https://github.com/simonw/llm-gpt4all/blob/0046e2bf5d0a9c369... https://github.com/simonw/llm-mlc/blob/b05eec9ba008e700ecc42... https://github.com/simonw/llm-llama-cpp/blob/29ee8d239f5cfbf... I'm not…
    comment by simonw · 2023-09-05 · in LLM Python/CLI tool adds support for embeddings
  2. …running something like https://github.com/simonw/llm , which also gives you options to e.g. use https://github.com/simonw/llm-mlc for accelerated inference?
    comment by avivo · 2023-08-17 · in Show HN: LlamaGPT – Self-hosted, offline, private AI chatbot, powered by Llama 2
  3. …around with local LLMs. I'm using the MLC version (since that works with a GPU on my M2 Mac) via my https://github.com/simonw/llm-mlc plugin.
    comment by simonw · 2023-08-15 · in Show HN: LLMs can generate valid JSON 100% of the time