Hacker GitHub

← All repos

maximhq/bifrost

View on GitHub ↗ ★ 9,291 Go

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

24 mentions on Hacker News by 12 people: 17 stories, 7 comments · first 2025-08-07 · latest 2026-10-13

Mentions per year 24 mentions · busiest year 2026 (16)
20082026
AllStoriesComments NewestTopOldest
  1. …server through tailscale. It makes it very easy to work across providers and platforms. [1] https://github.com/maximhq/bifrost
    comment by sixdimensional · 2026-10-09 · in Ask HN: What do you run on a $5 VPS that's worth keeping online 24/7?
  2. …to be competing directly with what you have to offer: - https://github.com/ENTERPILOT/GoModel - https://github.com/maximhq/bifrost - https://github.com/BerriAI/litellm Would you care to share what makes experiential different?
    comment by mongrelion · 2026-08-28 · in Show HN: We built open OpenRouter that turns usage into a better model
  3. …behind a license but the basics like provider proxy, logs, metrics are covered in the free version. https://github.com/maximhq/bifrost
    comment by rolls-reus · 2026-04-21 · in Show HN: GoModel – an open-source AI gateway in Go
  4. Bifrost is the only real alternative I'm aware of https://github.com/maximhq/bifrost
    comment by redrove · 2026-03-24 · in Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised
  5. …larger things (such as web pages) are stored in serverless LanceDB on Wasabi, too. Also Bifrost ( https://github.com/maximhq/bifrost ) as LLM gateway and Agentgateway ( https://github.com/agentgateway/agentgateway ) as MCP and OpenAPI/REST…
    comment by leventov · 2025-10-27 · in Let the little guys in: A context sharing runtime for the personalised web
  6. There is also https://github.com/maximhq/bifrost which apparently overcomes some performance issues of litellm and is easy to get going.
    comment by vid · 2025-08-12 · in Nexus: An Open-Source AI Router for Governance, Control and Observability
  7. …requests per second (with 4,100 RPS throughput) on a t3.xlarge instance. The benchmarks are here: https://github.com/maximhq/bifrost/blob/main/docs/benchmarks... Some features: • Built-in governance and routing rules • Supports over 1,000…
    comment by havercosine · 2025-08-07 · in Bitfrost – LLM gateway 90x faster than Litellm at p99