lm-sys/RouteLLM
View on GitHub ↗ ★ 5,690 Python
A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
6 mentions on Hacker News by 5 people: 1 story, 5 comments · first 2024-07-10 · latest 2025-04-25
20082026
-
▲ 244
RouteLLM: A framework for serving and evaluating LLM routersstory by djhu9 · 2024-07-10 · 36 comments