jondurbin/airoboros
View on GitHub ↗ ★ 1,053 Python
Customizable implementation of the self-instruct paper.
5 mentions on Hacker News by 5 people: 1 story, 4 comments · first 2023-08-24 · latest 2024-12-07
20082026
-
…airoboros: using large language models to fine-tune large language models https://github.com/jondurbin/airoboros
comment by suprjami · 2024-12-07 · in The Curse of Recursion: Training on generated data makes models forget (2023) -
…which is still in progress. [0] https://x.com/ggerganov/status/1698667093711880687?s=46&t=Jp... [1] https://github.com/jondurbin/airoboros#lmoe
comment by thawab · 2023-09-04 · in TinyLlama project aims to pretrain a 1.1B Llama model on 3T tokens -
…approach instead. Core idea is dynamically swapping PEFT adapters based on the incoming utterance. https://github.com/jondurbin/airoboros#lmoe
comment by spmurrayzzz · 2023-08-30 · in Understanding Llama 2 and the New Code Llama LLMs -
…models. There's a quite fresh and active project replicating something similar with herd of llamas: https://github.com/jondurbin/airoboros
comment by jmiskovic · 2023-08-24 · in Code Llama, a state-of-the-art large language model for coding