predibase/lorax
View on GitHub ↗ ★ 3,835 Python archived
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
6 mentions on Hacker News by 6 people: 3 stories, 3 comments · first 2023-11-16 · latest 2024-02-01
20082026
-
▲ 3
LoRAX: Hot swap LoRA adapters to serve many finetuned models concurrentlystory by magdyks · 2024-02-01 · 0 comments
-
…what I’m asking, I’m interested in learning about any known deployments and example setups. [0] https://github.com/predibase/lorax
comment by alchemist1e9 · 2024-01-31 · in Mistral CEO confirms 'leak' of new open source AI model nearing GPT4 performance -
Looks kind of inactive. https://github.com/predibase/lorax Does a similar thing and seems more active.
comment by dtks · 2023-12-14 · in S-LoRA: Serving Concurrent LoRA Adapters -
https://github.com/predibase/lorax does this, it's not that slow, since LoRAs aren't usually very big.
comment by ilaksh · 2023-12-01 · in Are Open-Source Large Language Models Catching Up? -
▲ 2
LoRAX: Serve 100s of Fine-tuned LLMs for the Cost of 1story by CharlesW · 2023-11-28 · 0 comments
-
▲ 5
Lorax: Serve 100s of Fine-Tuned LLMs in Production for the Cost of 1story by icyfox · 2023-11-16 · 1 comment