tloen/alpaca-lora
View on GitHub ↗ ★ 18,888 Jupyter Notebook
Instruct-tune LLaMA on consumer hardware
16 mentions on Hacker News by 15 people: 5 stories, 11 comments · first 2023-03-14 · latest 2023-07-28
20082026
-
…tons of them for other models, often Alpaca or LLaMA. This is a popular tool for finetuning Alpaca: https://github.com/tloen/alpaca-lora
comment by fnordpiglet · 2023-07-28 · in LLMs Unleashed: The Power of Fine-Tuning -
…capable of guiding repairs, or at least try to do so. So far doing inference only as well. [1] https://github.com/tloen/alpaca-lora
comment by FrostKiwi · 2023-04-10 · in The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT -
…about projects like https://github.com/ZrrSkywalker/LLaMA-Adapter https://github.com/microsoft/LoRA https://github.com/tloen/alpaca-lora and specifically the paper: https://arxiv.org/pdf/2106.09685.pdf Lora is just a way to re-train a…
comment by Grothendank · 2023-03-29 · in Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generations based on LLaMa -
…the parent comment: 1. I had no idea what lora is or how it relates to alpaca. 2. I looked up https://github.com/tloen/alpaca-lora 3. I read the abstract of the Lora paper: https://arxiv.org/pdf/2106.09685.pdf…
comment by Grothendank · 2023-03-29 · in Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generations based on LLaMa -
…soon, I'm confident, release e.g. an MIT-licensed equivalent and we'll all be off to the races. [0] https://github.com/tloen/alpaca-lora [1] https://crfm.stanford.edu/2023/03/13/alpaca.html
comment by numlocked · 2023-03-24 · in LoRA: Low-Rank Adaptation of Large Language Models -
…for: per_device_train_batch_size=1, per_device_eval_batch_size=1 - Fine-tuning dataset was based on https://github.com/tloen/alpaca-lora/raw/81eb72f707b0505a03b... with minor improvements; I'm going to publish my version soon - The…
comment by sockeye · 2023-03-23 · in Show HN: Web demo of 13B Alpaca-LLaMA trained on improved Stanford dataset -
did you use the cleaned and improved alpaca dataset from https://github.com/tloen/alpaca-lora/issues/28 ?
comment by underlines · 2023-03-22 · in Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA -
▲ 449
Show HN: Finetune LLaMA-7B on commodity GPUs using your own textstory by lxe · 2023-03-22 · 98 comments
-
Apparently can fine tune and run Alpaca-lora 7B using a single RTX 4090: https://github.com/tloen/alpaca-lora A few days ago before it was taken offline I did some tests I did with Alpaca-stanford. If I can run a GPT-3 level LLM in my…
comment by tarruda · 2023-03-20 · in OpenAI CEO warns that GPT-4 could be misused for nefarious purposes -
https://github.com/tloen/alpaca-lora
comment by mxby7e · 2023-03-18 · in Running LLaMA 7B on a 64GB M2 MacBook Pro with Llama.cpp -
Use this Alpaca replication instead https://github.com/tloen/alpaca-lora
comment by macrolime · 2023-03-17 · in Stanford Alpaca web demo suspended “until further notice” -
▲ 2
Code for reproducing the Stanford Alpaca InstructLLaMA on consumer hardwarestory by OkGoDoIt · 2023-03-16 · 0 comments
-
…repo for converting the weights back into a PyTorch dump- and my changes have since been merged https://github.com/tloen/alpaca-lora/pull/19
comment by antimatter15 · 2023-03-16 · in Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style LLM on a MacBook -
▲ 6
Alpaca-LoRA (LLaMA instruct fine-tune) – open-source training code and weightsstory by Tiberium · 2023-03-15 · 0 comments
-
▲ 8
Alpaca-LoRA: finetuning LLaMA to text-DaVinci-003 quality on consumer hardwarestory by axel_hwang · 2023-03-15 · 0 comments
-
▲ 2
Open source reproduction of Alpaca: instruction following LLAMA LLMstory by distbit · 2023-03-14 · 0 comments