katanemo/plano
View on GitHub ↗ ★ 7,104 Rust
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
40 mentions on Hacker News by 5 people: 22 stories, 18 comments · first 2024-10-10 · latest 2026-04-05
20082026
-
…need a data plane that handles all traffic to/from agents. An open source version of that is Plano: https://github.com/katanemo/plano . I am building it.
comment by honorable_coder · 2026-01-13 · in Agent Safety is a [bounded] Box -
…needs. [1] Arch-Router: https://huggingface.co/katanemo/Arch-Router-1.5B [2] Arch Gateway: https://github.com/katanemo/archgw
comment by sparacha · 2025-10-02 -
…can be opaque, hard to debug, and disconnected from real developer needs. [1] Arch Gateway repo: https://github.com/katanemo/archgw
comment by honorable_coder · 2025-09-30 · in Claude Code 2.0 Router – Aligning LLM routing to preferences, not benchmarks -
…and stays robust as conversations drift, without brittle thresholds or post-hoc cluster tuning. [1] https://github.com/katanemo/archgw [2] https://huggingface.co/katanemo/Arch-Router-1.5B [2] https://arxiv.org/abs/2506.16655
comment by honorable_coder · 2025-09-22 · in Model literals, semantic aliases, and preference-aligned routing for LLMs -
We use this technique heavily for function-calling scenarios in https://github.com/katanemo/archgw , which uses a 3b function-calling model to neatly map a user's ask to one of many tools — the model doesn’t need to write an essay, it just…
comment by honorable_coder · 2025-08-17 · in Detecting hallucinations in LLM function calling with entropy -
Hey! I built this. AMA. The model router is built into the proxy layer here: https://github.com/katanemo/archgw
comment by sparacha · 2025-08-02 · in Arch-Router: Aligning LLM Routing with Human Preferences -
…prompts as a first class citizen in the stack. You can check out their open source efforts here: https://github.com/katanemo/archgw
comment by honorable_coder · 2025-07-27 · in Are prompts the new unit of work? -
…service? But provider switching is built in some of these - and the folks behind envoy built: https://github.com/katanemo/archgw - developers can use an OpenAI client to call any model, offers preference-aligned intelligent routing to LLMs…
comment by honorable_coder · 2025-07-22 · in Show HN: Any-LLM – Lightweight router to access any LLM Provider -
the people behind envoy proxy built: https://github.com/katanemo/archgw - has the learnings of Envoy but natively designed to process/route prompts to agents and LLMs. Would be curious about your thoughts
comment by honorable_coder · 2025-07-22 · in Show HN: Any-LLM – Lightweight router to access any LLM Provider -
…models on our conversational routing benchmarks (details in the paper) Links: [1] Arch Proxy: https://github.com/katanemo/archgw
comment by honorable_coder · 2025-07-18 · in 1.5B LLM routing model that aligns to preferences, not leaderboards -
…Paper: https://arxiv.org/abs/2506.16655 Integrated experience via Arch: https://github.com/katanemo/archgw
comment by honorable_coder · 2025-07-15 · in An LLM Router That Thinks Like an Engineer -
Huh, this is pretty dope. I tried this example https://github.com/katanemo/archgw/blob/main/demos/samples_p... And was pleased with what I was able to do. Thanks
comment by mutant · 2025-07-13 · in Show HN: ArchGW – An intelligent edge and service proxy for agents -
…and build your own agentic app - added bonus have common tool calls be blazing fast. Just updated https://github.com/katanemo/archgw (the AI-native proxy server for agents) that can directly plug into your MCP tools and FastAPI functions…
comment by sparacha · 2025-04-18 -
…like openai, mistral, deepseek and also support hooking up to local providers like ollma [4] [1] - https://github.com/katanemo/archgw?tab=readme-ov-file#quicks... [2] - https://github.com/katanemo/archgw/tree/main/demos/use_cases... [3] -…
comment by adilhafeez · 2025-03-05 · in Show HN: ArchGW – An open-source intelligent proxy server for prompts -
…lot. More on that in next release. [1] https://huggingface.co/katanemo/Arch-Function-1.5B.gguf [2] https://github.com/katanemo/archgw/issues/286 [3] https://github.com/katanemo/archgw/blob/main/demos/insurance... [4]…
comment by adilhafeez · 2024-11-19 · in Show HN: archgw: open-source, intelligent proxy for AI agents, built on Envoy -
…and modify request with access_key from arch_config before sending request to upstream LLM [2]. [1] https://github.com/katanemo/archgw/tree/main/demos/llm_routi... [2] https://github.com/katanemo/archgw/blob/main/crates/llm_gate...
comment by adilhafeez · 2024-11-19 · in Show HN: archgw: open-source, intelligent proxy for AI agents, built on Envoy -
…If you want us to focus on this area more please go ahead and create an issue in our issues page at https://github.com/katanemo/arch/issues
comment by adilhafeez · 2024-10-16 · in Show HN: Arch – an intelligent prompt gateway built on Envoy -
You can also see current list of issues at https://github.com/katanemo/arch/issues , and can also post new feature requests and bug fixes there.
comment by adilhafeez · 2024-10-10 · in Show HN: Arch – an intelligent prompt gateway built on Envoy