Hacker GitHub

← All repos

microsoft/LoRA

View on GitHub ↗ ★ 13,896 Python

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

10 mentions on Hacker News by 9 people: 1 story, 9 comments · first 2023-03-24 · latest 2024-01-02

Mentions per year 10 mentions · busiest year 2023 (9)
20082026
AllStoriesComments NewestTopOldest
  1. I wonder how far you can push RAG and it's comparison to methods like LoRA https://github.com/microsoft/LoRA It seems like you can only get so far with a sophisticated prompt engineering framework like RAG. but I dunno, I haven't tested…
    comment by mnky9800n · 2024-01-02 · in Why RAG Is Big
  2. Curious if we'll see a Civitai-style LoRA[1] marketplace for text-to-speech models. 1 = https://github.com/microsoft/LoRA
    comment by carbocation · 2023-11-19 · in StyleTTS2 – open-source Eleven-Labs-quality Text To Speech
  3. …instead of adding a head on top of the network, most fine-tuning is currently done with LoRA ( https://github.com/microsoft/LoRA ). This introduces low-rank matrices between different layers of your models, those are then trained using…
    comment by baptiste1 · 2023-10-28 · in Is supervised learning dead for computer vision?
  4. …rank corrections, so this is what it is all about. I think that doing LoRa can be done locally. [1] https://github.com/microsoft/LoRA
    comment by bluepoint · 2023-06-08 · in GGML – AI at the Edge
  5. Microsoft also reused LoRA in the LLM context recently https://github.com/microsoft/LoRA sigh
    comment by tough · 2023-04-09 · in Fine-tuning with LoRA: create your own avatars and styles
  6. …parent comment. They're talking about projects like https://github.com/ZrrSkywalker/LLaMA-Adapter https://github.com/microsoft/LoRA https://github.com/tloen/alpaca-lora and specifically the paper: https://arxiv.org/pdf/2106.09685.pdf Lora…
    comment by Grothendank · 2023-03-29 · in Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generations based on LLaMa
  7. …adaptation" technique for training large language models, fairly recently published by Microsoft ( https://github.com/microsoft/LoRA ). In brief, the technique assumes that fine-tuning a model really just involves tweaks to the model…
    comment by Majromax · 2023-03-29 · in Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generations based on LLaMa
  8. https://github.com/microsoft/LoRA/issues/47
    comment by indeyets · 2023-03-24 · in LoRA: Low-Rank Adaptation of Large Language Models
  9. https://github.com/microsoft/LoRA/issues/47
    comment by indeyets · 2023-03-24 · in LoRA: Low-Rank Adaptation of Large Language Models
  10. ▲ 274
    LoRA: Low-Rank Adaptation of Large Language Models
    story by eternalban · 2023-03-24 · 156 comments