Hacker GitHub

← All repos

tloen/alpaca-lora

View on GitHub ↗ ★ 18,888 Jupyter Notebook

Instruct-tune LLaMA on consumer hardware

16 mentions on Hacker News by 15 people: 5 stories, 11 comments · first 2023-03-14 · latest 2023-07-28

Mentions per year 16 mentions · busiest year 2023 (16)
20082026
AllStoriesComments NewestTopOldest
  1. …tons of them for other models, often Alpaca or LLaMA. This is a popular tool for finetuning Alpaca: https://github.com/tloen/alpaca-lora
    comment by fnordpiglet · 2023-07-28 · in LLMs Unleashed: The Power of Fine-Tuning
  2. …capable of guiding repairs, or at least try to do so. So far doing inference only as well. [1] https://github.com/tloen/alpaca-lora
    comment by FrostKiwi · 2023-04-10 · in The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
  3. …about projects like https://github.com/ZrrSkywalker/LLaMA-Adapter https://github.com/microsoft/LoRA https://github.com/tloen/alpaca-lora and specifically the paper: https://arxiv.org/pdf/2106.09685.pdf Lora is just a way to re-train a…
    comment by Grothendank · 2023-03-29 · in Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generations based on LLaMa
  4. …the parent comment: 1. I had no idea what lora is or how it relates to alpaca. 2. I looked up https://github.com/tloen/alpaca-lora 3. I read the abstract of the Lora paper: https://arxiv.org/pdf/2106.09685.pdf…
    comment by Grothendank · 2023-03-29 · in Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generations based on LLaMa
  5. …soon, I'm confident, release e.g. an MIT-licensed equivalent and we'll all be off to the races. [0] https://github.com/tloen/alpaca-lora [1] https://crfm.stanford.edu/2023/03/13/alpaca.html
    comment by numlocked · 2023-03-24 · in LoRA: Low-Rank Adaptation of Large Language Models
  6. …for: per_device_train_batch_size=1, per_device_eval_batch_size=1 - Fine-tuning dataset was based on https://github.com/tloen/alpaca-lora/raw/81eb72f707b0505a03b... with minor improvements; I'm going to publish my version soon - The…
    comment by sockeye · 2023-03-23 · in Show HN: Web demo of 13B Alpaca-LLaMA trained on improved Stanford dataset
  7. did you use the cleaned and improved alpaca dataset from https://github.com/tloen/alpaca-lora/issues/28 ?
    comment by underlines · 2023-03-22 · in Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA
  8. Apparently can fine tune and run Alpaca-lora 7B using a single RTX 4090: https://github.com/tloen/alpaca-lora A few days ago before it was taken offline I did some tests I did with Alpaca-stanford. If I can run a GPT-3 level LLM in my…
    comment by tarruda · 2023-03-20 · in OpenAI CEO warns that GPT-4 could be misused for nefarious purposes
  9. https://github.com/tloen/alpaca-lora
    comment by mxby7e · 2023-03-18 · in Running LLaMA 7B on a 64GB M2 MacBook Pro with Llama.cpp
  10. Use this Alpaca replication instead https://github.com/tloen/alpaca-lora
    comment by macrolime · 2023-03-17 · in Stanford Alpaca web demo suspended “until further notice”
  11. …repo for converting the weights back into a PyTorch dump- and my changes have since been merged https://github.com/tloen/alpaca-lora/pull/19
    comment by antimatter15 · 2023-03-16 · in Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style LLM on a MacBook