Hacker GitHub

← All repos

guidance-ai/llguidance

View on GitHub ↗ ★ 906 Rust

Super-fast Structured Outputs

13 mentions on Hacker News by 9 people: 2 stories, 11 comments · first 2024-12-07 · latest 2025-12-20

Mentions per year 13 mentions · busiest year 2025 (10)
20082026
AllStoriesComments NewestTopOldest
  1. …and are using something less principled. 1: https://guidance-ai.github.io/llguidance/llg-go-brrr 2: https://github.com/guidance-ai/llguidance
    comment by osaariki · 2025-12-20 · in Response Healing: Reduce JSON defects by 80%+
  2. In OpenAI and a lot of open source inference engines this is done using llguidance. https://github.com/guidance-ai/llguidance Llguidance implements constrained decoding. It means that for each output token sequence you know which fixed set…
    comment by lukax · 2025-11-15 · in Structured outputs on the Claude Developer Platform
  3. …show any signs of Anthropic contributors, but I do see some from OpenAI and ByteDance Seed. [0] https://github.com/guidance-ai/llguidance
    comment by jumploops · 2025-11-14 · in Structured outputs on the Claude Developer Platform
  4. …to kick in though. [0] https://platform.openai.com/docs/guides/function-calling#lar... [1] https://github.com/guidance-ai/llguidance
    comment by mmoskal · 2025-11-14 · in Structured outputs on the Claude Developer Platform
  5. https://github.com/guidance-ai/llguidance > 2025-05-20 LLGuidance shipped in OpenAI for JSON Schema
    comment by koakuma-chan · 2025-11-14 · in Structured outputs on the Claude Developer Platform
  6. …optimizations to do this extremely quickly (eg for guidance, we detail some optimizations here https://github.com/guidance-ai/llguidance/blob/main/docs/opt... ). Other libraries work by essentially pre-computing all the masks for all…
    comment by FlyingLawnmower · 2025-09-23 · in Sampling and structured outputs in LLMs
  7. …you can make it easily work with spec dec too :). We manage to keep this on CPU. Some details here: https://github.com/guidance-ai/llguidance/blob/main/docs/opt...
    comment by FlyingLawnmower · 2025-09-23 · in Sampling and structured outputs in LLMs
  8. …library written for high performance mask computation (written mostly by my collaborator @mmoskal): http://github.com/guidance-ai/llguidance
    comment by FlyingLawnmower · 2025-09-23 · in Sampling and structured outputs in LLMs
  9. …from the Lark-like CFG of llguidance, which powers the JSON schema of the OpenAI API [^1]. [^1]: https://github.com/guidance-ai/llguidance/blob/f4592cc0c783a...
    comment by mehmetoguzderin · 2025-08-07 · in GPT-5 for Developers
  10. …make the choice though... [0] https://github.com/microsoft/derivre/blob/main/src/hashcons.... [1] https://github.com/guidance-ai/llguidance/blob/main/parser/s...
    comment by mmoskal · 2025-03-22 · in Oxidizing Ubuntu: adopting Rust utilities by default
  11. ▲ 1
    Low-Level Guidance Parser
    story by alex_hirner · 2024-12-20 · 0 comments
  12. ▲ 2
    llguidance: Enforce arbitrary context-free grammar on the output of LLM
    story by guerrilla · 2024-12-07 · 0 comments
  13. …any library. I did a PoC llama.cpp integration [2] though our focus is mostly server-side [3]. [0] https://github.com/guidance-ai/llguidance [1] https://github.com/guidance-ai/llguidance/blob/main/parser/s... [2]…
    comment by mmoskal · 2024-12-07 · in Structured Outputs with Ollama