predibase/lorax
View on GitHub ↗ ★ 3,835 Python archived
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
6 mentions on Hacker News by 6 people: 3 stories, 3 comments · first 2023-11-16 · latest 2024-02-01
20082026
-
▲ 3
LoRAX: Hot swap LoRA adapters to serve many finetuned models concurrentlystory by magdyks · 2024-02-01 · 0 comments
-
▲ 2
LoRAX: Serve 100s of Fine-tuned LLMs for the Cost of 1story by CharlesW · 2023-11-28 · 0 comments
-
▲ 5
Lorax: Serve 100s of Fine-Tuned LLMs in Production for the Cost of 1story by icyfox · 2023-11-16 · 1 comment