Hacker GitHub

← All repos

maximhq/bifrost

View on GitHub ↗ ★ 9,291 Go

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

24 mentions on Hacker News by 12 people: 17 stories, 7 comments · first 2025-08-07 · latest 2026-10-13

Mentions per year 24 mentions · busiest year 2026 (16)
20082026
  1. ▲ 4
    Show HN: Bifrost – High-performance AI gateway
    story by aanthonymax · 2026-10-13 · 0 comments
  2. …server through tailscale. It makes it very easy to work across providers and platforms. [1] https://github.com/maximhq/bifrost
  3. ▲ 3
    I Found One Interesting Open Source GitHub Gem
    story by aanthonymax · 2026-09-16 · 0 comments
  4. …to be competing directly with what you have to offer: - https://github.com/ENTERPILOT/GoModel - https://github.com/maximhq/bifrost - https://github.com/BerriAI/litellm Would you care to share what makes experiential different?
  5. ▲ 1
    The worst part of using multiple LLM providers is not the API differences
    story by Swapnoneel · 2026-08-11 · 0 comments
  6. ▲ 1
    I thought an LLM gateway was unnecessary. Then we added a second model provider
    story by Swapnoneel · 2026-08-10 · 1 comment
  7. ▲ 2
    Show HN: A model router should also provide a MCP gateway
    story by Swapnoneel · 2026-08-07 · 0 comments
  8. ▲ 1
    Show HN: Bifrost: Enterprise MCP Gateway with Built-In Security: OAuth 2.0, RBAC
    story by aanthonymax · 2026-08-05 · 0 comments
  9. ▲ 1
    Is Hermes Agent unusable without a model router?
    story by Swapnoneel · 2026-08-03 · 1 comment
  10. ▲ 3
    Show HN: Changed how I use agent harnesses
    story by Swapnoneel · 2026-08-03 · 0 comments
  11. ▲ 2
    Show HN: Fastest Enterprise AI Gateway
    story by aanthonymax · 2026-07-02 · 0 comments
  12. …behind a license but the basics like provider proxy, logs, metrics are covered in the free version. https://github.com/maximhq/bifrost
  13. Bifrost is the only real alternative I'm aware of https://github.com/maximhq/bifrost
  14. ▲ 1
    Bifrost CLI and Codex CLI: One Command to Set Up OpenAI Agent with Any Model
    story by aanthonymax · 2026-03-19 · 0 comments
  15. ▲ 1
    Show HN: Bifrost: Fastest enterprise AI gateway
    story by aanthonymax · 2026-02-13 · 0 comments
  16. ▲ 2
    Show HN: Fastest LLM gateway (50x faster than LiteLLM)
    story by aanthonymax · 2026-01-30 · 0 comments
  17. ▲ 2
    Every LLM gateway we tested failed at scale – ended up building Bifrost
    story by PranayBatta · 2025-12-10 · 1 comment
  18. ▲ 3
    Show HN: Bifrost – open-source LLM Gateway (50x lower latency than LiteLLM)
    story by dskuldeep · 2025-12-09 · 0 comments
  19. ▲ 5
    50× faster than LiteLLM: Bifrost is a Go-based LLM gateway built for scale.
    story by PranayBatta · 2025-12-08 · 0 comments
  20. …larger things (such as web pages) are stored in serverless LanceDB on Wasabi, too. Also Bifrost ( https://github.com/maximhq/bifrost ) as LLM gateway and Agentgateway ( https://github.com/agentgateway/agentgateway ) as MCP and OpenAPI/REST…
  21. ▲ 1
    Ollama and Bifrost –> Qwen3 in Claude Code
    story by all2 · 2025-09-04 · 2 comments
  22. There is also https://github.com/maximhq/bifrost which apparently overcomes some performance issues of litellm and is easy to get going.
  23. …requests per second (with 4,100 RPS throughput) on a t3.xlarge instance. The benchmarks are here: https://github.com/maximhq/bifrost/blob/main/docs/benchmarks... Some features: • Built-in governance and routing rules • Supports over 1,000…
  24. ▲ 8
    Bitfrost – LLM gateway 90x faster than Litellm at p99
    story by havercosine · 2025-08-07 · 1 comment