Hacker GitHub

← All repos

Mattbusel/tokio-prompt-orchestrator

View on GitHub ↗ ★ 60 Rust

LLM API proxy. Same prompt twice costs one call.

3 mentions on Hacker News by 1 person: 2 stories, 1 comment · first 2026-02-21 · latest 2026-02-24

Mentions per year 3 mentions · busiest year 2026 (3)
20082026
AllStoriesComments NewestTopOldest
  1. …with circuit breakers Sub-millisecond pipeline overhead (inference dominates at 3.6s on Mistral 7B) Repo: github.com/Mattbusel/tokio-prompt-orchestrator
    comment by Shmungus · 2026-02-21 · in 24 Simultaneous Claude Code agents on local hardware