katanemo/plano
View on GitHub ↗ ★ 7,104 Rust
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
40 mentions on Hacker News by 5 people: 22 stories, 18 comments · first 2024-10-10 · latest 2026-04-05
20082026
-
▲ 3
Show HN: Signals – finding the most informative agent traces without LLM judgesstory by sparacha · 2026-04-05 · 0 comments
-
▲ 1
Show HN: Preference-aware routing for OpenClaw via Planostory by sparacha · 2026-02-17 · 0 comments
-
…need a data plane that handles all traffic to/from agents. An open source version of that is Plano: https://github.com/katanemo/plano . I am building it.
comment by honorable_coder · 2026-01-13 · in Agent Safety is a [bounded] Box -
▲ 8
Show HN: Plano – Edge and service proxy with orchestration for AI agentsstory by adilhafeez · 2026-01-06 · 2 comments
-
…needs. [1] Arch-Router: https://huggingface.co/katanemo/Arch-Router-1.5B [2] Arch Gateway: https://github.com/katanemo/archgw
comment by sparacha · 2025-10-02 -
▲ 4
Show HN: Claude Code 2.0 router – preference-aligned routing to multiple LLMsstory by adilhafeez · 2025-10-01 · 1 comment
-
…can be opaque, hard to debug, and disconnected from real developer needs. [1] Arch Gateway repo: https://github.com/katanemo/archgw
comment by honorable_coder · 2025-09-30 · in Claude Code 2.0 Router – Aligning LLM routing to preferences, not benchmarks -
▲ 2
Claude Code 2.0 Router – Aligning LLM routing to preferences, not benchmarksstory by honorable_coder · 2025-09-30 · 1 comment
-
…and stays robust as conversations drift, without brittle thresholds or post-hoc cluster tuning. [1] https://github.com/katanemo/archgw [2] https://huggingface.co/katanemo/Arch-Router-1.5B [2] https://arxiv.org/abs/2506.16655
comment by honorable_coder · 2025-09-22 · in Model literals, semantic aliases, and preference-aligned routing for LLMs -
▲ 2
Show HN: Model-literals, model-aliases, and preference-aligned routing for LLMsstory by honorable_coder · 2025-09-21 · 0 comments
-
▲ 4
Show HN: Detecting hallucinations in LLM function calling with entropystory by honorable_coder · 2025-08-17 · 0 comments
-
We use this technique heavily for function-calling scenarios in https://github.com/katanemo/archgw , which uses a 3b function-calling model to neatly map a user's ask to one of many tools — the model doesn’t need to write an essay, it just…
comment by honorable_coder · 2025-08-17 · in Detecting hallucinations in LLM function calling with entropy -
▲ 1
Show HN: Arch-Router – Aligning LLM Routing with Human Preferencesstory by honorable_coder · 2025-08-03 · 0 comments
-
Hey! I built this. AMA. The model router is built into the proxy layer here: https://github.com/katanemo/archgw
comment by sparacha · 2025-08-02 · in Arch-Router: Aligning LLM Routing with Human Preferences -
…prompts as a first class citizen in the stack. You can check out their open source efforts here: https://github.com/katanemo/archgw
comment by honorable_coder · 2025-07-27 · in Are prompts the new unit of work? -
…service? But provider switching is built in some of these - and the folks behind envoy built: https://github.com/katanemo/archgw - developers can use an OpenAI client to call any model, offers preference-aligned intelligent routing to LLMs…
comment by honorable_coder · 2025-07-22 · in Show HN: Any-LLM – Lightweight router to access any LLM Provider -
the people behind envoy proxy built: https://github.com/katanemo/archgw - has the learnings of Envoy but natively designed to process/route prompts to agents and LLMs. Would be curious about your thoughts
comment by honorable_coder · 2025-07-22 · in Show HN: Any-LLM – Lightweight router to access any LLM Provider -
▲ 2
Show HN: RouteGPT – model routing on ChatGPT aligned to user preferencesstory by honorable_coder · 2025-07-22 · 0 comments
-
…models on our conversational routing benchmarks (details in the paper) Links: [1] Arch Proxy: https://github.com/katanemo/archgw
comment by honorable_coder · 2025-07-18 · in 1.5B LLM routing model that aligns to preferences, not leaderboards -
▲ 4
Show HN: 1.5B LLM routing model that aligns to preferences, not leaderboardsstory by honorable_coder · 2025-07-17 · 0 comments
-
…Paper: https://arxiv.org/abs/2506.16655 Integrated experience via Arch: https://github.com/katanemo/archgw
comment by honorable_coder · 2025-07-15 · in An LLM Router That Thinks Like an Engineer -
Huh, this is pretty dope. I tried this example https://github.com/katanemo/archgw/blob/main/demos/samples_p... And was pleased with what I was able to do. Thanks
comment by mutant · 2025-07-13 · in Show HN: ArchGW – An intelligent edge and service proxy for agents -
▲ 118
Show HN: ArchGW – An intelligent edge and service proxy for agentsstory by honorable_coder · 2025-07-12 · 15 comments
-
▲ 66
Show HN: Arch-Router – 1.5B model for LLM routing by preferences, not benchmarksstory by adilhafeez · 2025-07-01 · 15 comments
-
▲ 6
Show HN: LMM for LLMs – A mental model for building LLM appsstory by honorable_judge · 2025-04-22 · 2 comments
-
…and build your own agentic app - added bonus have common tool calls be blazing fast. Just updated https://github.com/katanemo/archgw (the AI-native proxy server for agents) that can directly plug into your MCP tools and FastAPI functions…
comment by sparacha · 2025-04-18 -
…like openai, mistral, deepseek and also support hooking up to local providers like ollma [4] [1] - https://github.com/katanemo/archgw?tab=readme-ov-file#quicks... [2] - https://github.com/katanemo/archgw/tree/main/demos/use_cases... [3] -…
comment by adilhafeez · 2025-03-05 · in Show HN: ArchGW – An open-source intelligent proxy server for prompts -
▲ 39
Show HN: ArchGW – An open-source intelligent proxy server for promptsstory by sparacha · 2025-03-04 · 7 comments
-
▲ 2
ArchGW: Open-source, AI-native (edge and LLM) proxy for prompt trafficstory by sparacha · 2025-02-07 · 1 comment
-
▲ 3
Show HN: Intelligent proxy for human-in-the-loop agents written in Ruststory by honorable_judge · 2024-11-26 · 1 comment
-
▲ 4
Envoy (Proxy) but for AI Agentsstory by honorable_judge · 2024-11-26 · 0 comments
-
…lot. More on that in next release. [1] https://huggingface.co/katanemo/Arch-Function-1.5B.gguf [2] https://github.com/katanemo/archgw/issues/286 [3] https://github.com/katanemo/archgw/blob/main/demos/insurance... [4]…
comment by adilhafeez · 2024-11-19 · in Show HN: archgw: open-source, intelligent proxy for AI agents, built on Envoy -
…and modify request with access_key from arch_config before sending request to upstream LLM [2]. [1] https://github.com/katanemo/archgw/tree/main/demos/llm_routi... [2] https://github.com/katanemo/archgw/blob/main/crates/llm_gate...
comment by adilhafeez · 2024-11-19 · in Show HN: archgw: open-source, intelligent proxy for AI agents, built on Envoy -
▲ 20
Show HN: archgw: open-source, intelligent proxy for AI agents, built on Envoystory by adilhafeez · 2024-11-19 · 14 comments
-
▲ 7
Show HN: Arch GW – Distributed gateway for agents, engineered with small LLMsstory by sparacha · 2024-11-09 · 0 comments
-
…If you want us to focus on this area more please go ahead and create an issue in our issues page at https://github.com/katanemo/arch/issues
comment by adilhafeez · 2024-10-16 · in Show HN: Arch – an intelligent prompt gateway built on Envoy -
▲ 21
Show HN: Arch – an intelligent prompt gateway built on Envoystory by adilhafeez · 2024-10-16 · 19 comments
-
▲ 5
Show HN: Arch-Function: 3B parameter LLM that beats GPT-4o on function callingstory by sparacha · 2024-10-16 · 0 comments
-
You can also see current list of issues at https://github.com/katanemo/arch/issues , and can also post new feature requests and bug fixes there.
comment by adilhafeez · 2024-10-10 · in Show HN: Arch – an intelligent prompt gateway built on Envoy -
▲ 31
Show HN: Arch – an intelligent prompt gateway built on Envoystory by adilhafeez · 2024-10-10 · 1 comment