zphang/minimal-llama
View on GitHub ↗ ★ 453 Python
6 mentions on Hacker News by 2 people: 1 story, 5 comments · first 2023-03-10 · latest 2023-03-22
20082026
-
…Hivemind and Petals. I bookmarked a bunch of resources but it's very sporadic. Here are some: - https://github.com/zphang/minimal-llama/#peft-fine-tuning-wi... - https://github.com/togethercomputer/OpenChatKit -…
comment by lxe · 2023-03-22 · in Show HN: Finetune LLaMA-7B on commodity GPUs using your own text -
You can probably finetune a 13b one with that. Try these scripts: https://github.com/zphang/minimal-llama/#minimal-llama
comment by lxe · 2023-03-22 · in Show HN: Finetune LLaMA-7B on commodity GPUs using your own text -
…consumer GPU or in a free Colab with just 12GB of VRAM, and soon 6GB in 4bit training, using PEFT. https://github.com/zphang/minimal-llama#peft-fine-tuning-wit...
comment by MacsHeadroom · 2023-03-13 · in Dalai: Automatically install, run, and play with LLaMA on your computer -
…tuning LLaMA in 8bit has been done. It requires very little VRAM compared to typical fine tuning. https://github.com/zphang/minimal-llama#peft-fine-tuning-wit...
comment by MacsHeadroom · 2023-03-11 · in LLaMA Text-Generation-Webui -
…a possibility but I'm not aware of anyone working on it yet. LoRa has already been implemented. See https://github.com/zphang/minimal-llama#peft-fine-tuning-wit...
comment by MacsHeadroom · 2023-03-10 · in Visual ChatGPT