artidoro/qlora
View on GitHub ↗ ★ 11,067 Jupyter Notebook
QLoRA: Efficient Finetuning of Quantized LLMs
7 mentions on Hacker News by 7 people: 2 stories, 5 comments · first 2023-05-24 · latest 2023-09-28
20082026
-
Take a look at the QLoRA repo https://github.com/artidoro/qlora/ which has an example finetuning Llama. Made by the authors of the QLoRA paper.
comment by Karrot_Kream · 2023-09-28 · in Mistral 7B -
…You can use this https://github.com/PygmalionAI/training-code Or, you can use this; for QLoRA https://github.com/artidoro/qlora The tools and mechanisms to get a model to do what you want is ever so changing, ever so quickly. Build and…
comment by yacine_ · 2023-07-26 · in Tuning and Testing Llama 2, Flan-T5, and GPT-J with LoRA, Sematic, and Gradio -
I used: https://github.com/artidoro/qlora but there are quite a few others that likely work better. It was literally my first attempt at doing anything like this, and took the better part of an evening to work through CUDA/Python issues to…
comment by Tostino · 2023-06-26 · in Databricks Strikes $1.3B Deal for Generative AI Startup MosaicML -
…run it, Guanaco-65B is probably as close as you can get in terms of something publicly available. https://github.com/artidoro/qlora . But as other comments mention, it's still noticeably worse in my experience.
comment by amilios · 2023-05-31 · in Ask HN: What's the best self hosted/local alternative to GPT-4? -
Currently SOTA for specialization of LLMs is QLoRA: https://github.com/artidoro/qlora
comment by f_devd · 2023-05-27 · in The False Promise of Imitating Proprietary LLMs