microsoft/aici
View on GitHub ↗ ★ 2,074 Rust
AICI: Prompts as (Wasm) Programs
10 mentions on Hacker News by 7 people: 2 stories, 8 comments · first 2024-02-09 · latest 2025-08-19
20082026
-
…decode from the big llm providers to skip some sources of needing to loop - something like https://github.com/microsoft/aici
comment by mgsloan2 · 2025-08-19 · in MCP doesn't need tools, it needs code -
…to get the Agent to produce the right output. Side note, this is also why I like the AICI approach: https://github.com/microsoft/aici A lot of us think it is silly how the phrasing and word choice can produce dramatically different results…
comment by faizshah · 2024-06-18 · in What Is ChatGPT Doing and Why Does It Work? (2023) -
…subset of what is possible with full control over the model. I consider this a more complete list: https://github.com/microsoft/aici?tab=readme-ov-file#flexibi... Context caching only gets you “forking generation into multiple branches”…
comment by conradev · 2024-05-16 · in Context caching guide -
Have you looked at AICI by Microsoft yet? https://github.com/microsoft/aici/
comment by ricopags · 2024-04-16 · in HonoJS: Small, simple, and ultrafast web framework for the Edges -
…"snippet patterns" and architectural choices while other tools (Ghidra, LLVM) worry about the rest. https://github.com/microsoft/aici Obviously this is all hand-wavey armchair commentary from a former grad student who just thinks this…
comment by dwrodri · 2024-03-18 · in LLM4Decompile: Decompiling Binary Code with LLM -
…AICI is generally lower level (though our sample controllers are at similar level to Guidance). [0] https://github.com/microsoft/aici/blob/main/controllers/aici...
comment by mmoskal · 2024-03-11 · in Show HN: Prompts as WASM Programs -
…in my testing (20ms per token or so, compared to 2ms for the yacc grammar referenced above). [0] https://github.com/microsoft/aici/blob/main/controllers/pyct...
comment by mmoskal · 2024-03-11 · in Show HN: Prompts as WASM Programs -
This kind of low level strategies can be tried on many models using AICI, including the substring one https://github.com/microsoft/aici/blob/main/controllers/aici...
comment by mmoskal · 2024-03-09 · in Self-Retrieval: Building an information retrieval system with one LLM