lm-sys/RouteLLM
View on GitHub ↗ ★ 5,690 Python
A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
6 mentions on Hacker News by 5 people: 1 story, 5 comments · first 2024-07-10 · latest 2025-04-25
20082026
-
…but most of the tasks don't even require such power (on building ai agentic systems) there's also https://github.com/lm-sys/RouteLLM and other similar I guess your system is not as open-ended task oriented so you can just build workflows…
comment by tough · 2025-04-25 · in Show HN: Magnitude – open-source, AI-native test framework for web apps -
there's RouteLLM: https://github.com/lm-sys/RouteLLM nvidia has LLMRouter https://build.nvidia.com/nvidia/llm-router llama-index also supports routing https://docs.llamaindex.ai/en/stable/examples/low_level/rout... semantic router seems…
comment by tough · 2025-04-13 · in Skywork-OR1: new SOTA 32B thinking model with open weight -
you're doing model routing - any thoughts on https://github.com/lm-sys/RouteLLM and Martian? hope you dont raise funding before you figure out what they haven't
comment by swyx · 2024-10-24 · in Show HN: PreCog AI – Automatic AI Model Selection for Any Task -
try https://github.com/lm-sys/RouteLLM video: https://www.youtube.com/watch?v=mcZKQe2pUA0
comment by gbertb · 2024-10-02 · in Ask HN: LLM Router Recommendations -
Haven't tried any yet, but it sounds like parent may be interested in an LLM router. https://github.com/lm-sys/RouteLLM
comment by laborcontract · 2024-07-18 · in GPT-4o mini: advancing cost-efficient intelligence