Hacker GitHub

← All repos

cocktailpeanut/dalai

View on GitHub ↗ ★ 12,872 CSS

The simplest way to run LLaMA on your local machine

14 mentions on Hacker News by 14 people: 3 stories, 11 comments · first 2023-03-13 · latest 2023-08-04

Mentions per year 14 mentions · busiest year 2023 (14)
20082026
AllStoriesComments NewestTopOldest
  1. …makes it impractical for most vs just running it in Colab or something. Tho there are some efforts: https://github.com/cocktailpeanut/dalai
    comment by TheRealSteel · 2023-08-04 · in Ask HN: What are the capabilities of consumer grade hardware to work with LLMs?
  2. …locally for the first time, this is the simplest project I've found and has a simple web UI: https://github.com/cocktailpeanut/dalai It works for 7B/13B/30B/65B LLaMA and Alpaca (fine-tuned LLaMA which definitely works better). The smaller…
    comment by estreeper · 2023-07-14 · in Meta to release open-source commercial AI model
  3. I had it running before with Dalai ( https://github.com/cocktailpeanut/dalai ) but have since moved to using the browser based WebGPU method ( https://mlc.ai/web-llm/ ) which uses Vicuna 7B and is quite good.
    comment by DustinBrett · 2023-04-30 · in A brief history of LLaMA models
  4. …-> https://old.reddit.com/user/Crataco/comments/zuowi9/opensour... https://github.com/cocktailpeanut/dalai the 4-bit quantized version of LLaMA 13B runs on my laptop without a dedicated GPU and I guess the same would apply to
    comment by muyuu · 2023-04-04 · in State-of-the-art open-source chatbot, Vicuna-13B, just released model weights
  5. …github.com/jerryjliu/llama_index/blob/046183303da416... but it calls hugging face. My plan was to use https://github.com/cocktailpeanut/dalai with the alpaca model then somehow use llamaindex to input my dataset - a slack export. But it's…
    comment by zikohh · 2023-03-27 · in Retrieval in LangChain
  6. Just hacked together a library to use LLaMa and Alpaca through Dalai ( https://github.com/cocktailpeanut/dalai )
    comment by wastella · 2023-03-26 · in Hacked Together a Python Wrapper for Dalai (LLaMa and Alpaca)
  7. …completes the request. ### Instruction: {instruction} ### Input: {input} ### Response: [1] https://github.com/cocktailpeanut/dalai
    comment by Method-X · 2023-03-22 · in Show HN: Finetune LLaMA-7B on commodity GPUs using your own text
  8. …memory i believe? [2]: https://github.com/shawwn/llama-dl/blob/main/llama.sh edit : I forgot about https://github.com/cocktailpeanut/dalai - i suspect this is best in breed atm? Though a Docker container would be nice to wrangle all the…
    comment by unshavedyak · 2023-03-17 · in Load LLaMA Models Instantly
  9. Another answer in the thread said this: > I'm pretty sure there's a mistake here: https://github.com/cocktailpeanut/dalai/blob/main/index.js#L ... , there's a ${suffix} missing > It causes the quantization to process to always use the…
    comment by geysersam · 2023-03-13 · in Dalai: Automatically install, run, and play with LLaMA on your computer
  10. I'm pretty sure there's a mistake here: https://github.com/cocktailpeanut/dalai/blob/main/index.js#L... , there's a ${suffix} missing It causes the quantization to process to always use the first part of the model if using a larger size…
    comment by chocolatkey · 2023-03-13 · in Dalai: Automatically install, run, and play with LLaMA on your computer
  11. you could clone the repo and comment out https://github.com/cocktailpeanut/dalai/blob/main/index.js#L... i.e. the specific synchronous download call..?
    comment by gregsadetsky · 2023-03-13 · in Dalai: Automatically install, run, and play with LLaMA on your computer