huggingface/peft
View on GitHub ↗ ★ 21,877 Python
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
8 mentions on Hacker News by 8 people: 1 story, 7 comments · first 2023-03-22 · latest 2026-05-27
20082026
-
PEFT is more niche as it's a specific library ( https://github.com/huggingface/peft ) that creates LoRAs, but for a machine learning engineer working with LLM models outside of just prompting an API, it's within scope to know why/how a…
comment by minimaxir · 2026-05-27 · in The worst job interview I ever had -
…I think you could probably fine-tune a model up to ~13B parameters on one of them with PEFT ( https://github.com/huggingface/peft )
comment by dmakian · 2023-12-05 · in Fine-tuning Mistral 7B on Magic the Gathering Draft -
…of those have any version specified. The rest? "Meh, I don't care, whatever." Then this beauty: git+https://github.com/huggingface/peft I love reaching out to the Internet in the middle of a build pipeline to pull the latest commit of a…
comment by jiggawatts · 2023-04-30 · in A brief history of LLaMA models -
…but I imagine it's possible since they can be loaded as regular transformers. Check out https://github.com/huggingface/peft -- they've packaged it up nicely- and read up on LoRA ( https://arxiv.org/pdf/2106.09685.pdf ) That should get you…
comment by batch12 · 2023-04-29 · in Launch Lamini: The LLM Engine for Rapidly Customizing Models as Good as ChatGPT -
…peft library would be amazing. That's the main library that people using LoRA are currently using. https://github.com/huggingface/peft/issues/289
comment by kernelsanderz · 2023-04-10 · in DyLoRA: Parameter Efficient Tuning of Pre-Trained Models -
TIL learned about LoRA via https://news.ycombinator.com/item?id=35287740 See also: Huggingface PEFT: https://github.com/huggingface/peft
comment by eternalban · 2023-03-24 · in LoRA: Low-Rank Adaptation of Large Language Models -
…- https://www.cstroik.com/index.php/2023/02/18/finetuning-an-a... - https://github.com/huggingface/peft - https://github.com/kingoflolz/mesh-transformer-jax/blob/mast... - https://github.com/oobabooga/text-generation-webui - h
comment by lxe · 2023-03-22 · in Show HN: Finetune LLaMA-7B on commodity GPUs using your own text