maximhq/bifrost
View on GitHub ↗ ★ 9,291 Go
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
24 mentions on Hacker News by 12 people: 17 stories, 7 comments · first 2025-08-07 · latest 2026-10-13
20082026
-
▲ 4
Show HN: Bifrost – High-performance AI gatewaystory by aanthonymax · 2026-10-13 · 0 comments
-
…server through tailscale. It makes it very easy to work across providers and platforms. [1] https://github.com/maximhq/bifrost
comment by sixdimensional · 2026-10-09 · in Ask HN: What do you run on a $5 VPS that's worth keeping online 24/7? -
▲ 3
I Found One Interesting Open Source GitHub Gemstory by aanthonymax · 2026-09-16 · 0 comments
-
…to be competing directly with what you have to offer: - https://github.com/ENTERPILOT/GoModel - https://github.com/maximhq/bifrost - https://github.com/BerriAI/litellm Would you care to share what makes experiential different?
comment by mongrelion · 2026-08-28 · in Show HN: We built open OpenRouter that turns usage into a better model -
▲ 1
The worst part of using multiple LLM providers is not the API differencesstory by Swapnoneel · 2026-08-11 · 0 comments
-
▲ 1
I thought an LLM gateway was unnecessary. Then we added a second model providerstory by Swapnoneel · 2026-08-10 · 1 comment
-
▲ 2
Show HN: A model router should also provide a MCP gatewaystory by Swapnoneel · 2026-08-07 · 0 comments
-
▲ 1
Show HN: Bifrost: Enterprise MCP Gateway with Built-In Security: OAuth 2.0, RBACstory by aanthonymax · 2026-08-05 · 0 comments
-
▲ 1
Is Hermes Agent unusable without a model router?story by Swapnoneel · 2026-08-03 · 1 comment
-
▲ 3
Show HN: Changed how I use agent harnessesstory by Swapnoneel · 2026-08-03 · 0 comments
-
▲ 2
Show HN: Fastest Enterprise AI Gatewaystory by aanthonymax · 2026-07-02 · 0 comments
-
…behind a license but the basics like provider proxy, logs, metrics are covered in the free version. https://github.com/maximhq/bifrost
comment by rolls-reus · 2026-04-21 · in Show HN: GoModel – an open-source AI gateway in Go -
Bifrost is the only real alternative I'm aware of https://github.com/maximhq/bifrost
comment by redrove · 2026-03-24 · in Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised -
▲ 1
Bifrost CLI and Codex CLI: One Command to Set Up OpenAI Agent with Any Modelstory by aanthonymax · 2026-03-19 · 0 comments
-
▲ 1
Show HN: Bifrost: Fastest enterprise AI gatewaystory by aanthonymax · 2026-02-13 · 0 comments
-
▲ 2
Show HN: Fastest LLM gateway (50x faster than LiteLLM)story by aanthonymax · 2026-01-30 · 0 comments
-
▲ 2
Every LLM gateway we tested failed at scale – ended up building Bifroststory by PranayBatta · 2025-12-10 · 1 comment
-
▲ 3
Show HN: Bifrost – open-source LLM Gateway (50x lower latency than LiteLLM)story by dskuldeep · 2025-12-09 · 0 comments
-
▲ 5
50× faster than LiteLLM: Bifrost is a Go-based LLM gateway built for scale.story by PranayBatta · 2025-12-08 · 0 comments
-
…larger things (such as web pages) are stored in serverless LanceDB on Wasabi, too. Also Bifrost ( https://github.com/maximhq/bifrost ) as LLM gateway and Agentgateway ( https://github.com/agentgateway/agentgateway ) as MCP and OpenAPI/REST…
comment by leventov · 2025-10-27 · in Let the little guys in: A context sharing runtime for the personalised web -
▲ 1
Ollama and Bifrost –> Qwen3 in Claude Codestory by all2 · 2025-09-04 · 2 comments
-
There is also https://github.com/maximhq/bifrost which apparently overcomes some performance issues of litellm and is easy to get going.
comment by vid · 2025-08-12 · in Nexus: An Open-Source AI Router for Governance, Control and Observability -
…requests per second (with 4,100 RPS throughput) on a t3.xlarge instance. The benchmarks are here: https://github.com/maximhq/bifrost/blob/main/docs/benchmarks... Some features: • Built-in governance and routing rules • Supports over 1,000…
comment by havercosine · 2025-08-07 · in Bitfrost – LLM gateway 90x faster than Litellm at p99 -
▲ 8
Bitfrost – LLM gateway 90x faster than Litellm at p99story by havercosine · 2025-08-07 · 1 comment