sturnus-dev/sturnus
View on GitHub ↗ ★ 13 Rust
Latency-based load balancing across OpenAI, Azure OpenAI, Vertex AI and Anthropic. An OpenAI-compatible sidecar in a single static binary.
3 mentions on Hacker News by 1 person: 2 stories, 1 comment · first 2026-06-22 · latest 2026-10-26
20082026
-
▲ 1
Show HN: Sturnus, a latency-based LLM load balancerstory by dannyboland · 2026-10-26 · 0 comments
-
…routing across multiple providers based on latency) and built that as a small static Rust binary - https://github.com/sturnus-dev/sturnus Now that AI makes it cheaper to build such tools in-house, the case for adopting a maximalist…
comment by dannyboland · 2026-10-21 · in Compromised LiteLLM 1.107.0 on PyPI Installs a Credential Stealer and Backdoor -
▲ 3
Show HN: Sturnus – OpenAI-compatible LLM proxy routing to the fastest providerstory by dannyboland · 2026-06-22 · 0 comments