predibase/lorax
View on GitHub ↗ ★ 3,835 Python archived
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
6 mentions on Hacker News by 6 people: 3 stories, 3 comments · first 2023-11-16 · latest 2024-02-01
20082026
-
…what I’m asking, I’m interested in learning about any known deployments and example setups. [0] https://github.com/predibase/lorax
comment by alchemist1e9 · 2024-01-31 · in Mistral CEO confirms 'leak' of new open source AI model nearing GPT4 performance -
Looks kind of inactive. https://github.com/predibase/lorax Does a similar thing and seems more active.
comment by dtks · 2023-12-14 · in S-LoRA: Serving Concurrent LoRA Adapters -
https://github.com/predibase/lorax does this, it's not that slow, since LoRAs aren't usually very big.
comment by ilaksh · 2023-12-01 · in Are Open-Source Large Language Models Catching Up?