Hacker GitHub

← All repos

Mattbusel/tokio-prompt-orchestrator

View on GitHub ↗ ★ 60 Rust

LLM API proxy. Same prompt twice costs one call.

3 mentions on Hacker News by 1 person: 2 stories, 1 comment · first 2026-02-21 · latest 2026-02-24

Mentions per year 3 mentions · busiest year 2026 (3)
20082026
  1. ▲ 2
    Show HN: Tokio-prompt-orchestrator – LLM pipeline orchestration in Rust
    story by Shmungus · 2026-02-24 · 0 comments
  2. …with circuit breakers Sub-millisecond pipeline overhead (inference dominates at 3.6s on Mistral 7B) Repo: github.com/Mattbusel/tokio-prompt-orchestrator
  3. ▲ 2
    24 Simultaneous Claude Code agents on local hardware
    story by Shmungus · 2026-02-21 · 1 comment