Hacker GitHub

← All repos

guidance-ai/guidance

View on GitHub ↗ ★ 21,813 Jupyter Notebook

A guidance language for controlling large language models.

72 mentions on Hacker News by 64 people: 9 stories, 63 comments · first 2023-05-09 · latest 2026-09-15

Mentions per year 72 mentions · busiest year 2023 (52)
20082026
AllStoriesComments NewestTopOldest
  1. Have you tried guidance? https://github.com/microsoft/guidance
    comment by vczf · 2023-07-07 · in GPT-4 API General Availability
  2. …And it has its own caching. Set temp to 0 and it caches. no need for LLM specific caching libs :) ) https://github.com/microsoft/guidance
    comment by adamgordonbell · 2023-06-21 · in Emerging architectures for LLM applications
  3. …like Guidance where you have a pre structured JSON format ready to go and all you need is text: https://github.com/microsoft/guidance
    comment by imranq · 2023-06-14 · in Native JSON Output from GPT-4
  4. …to fine-tuning validator models to new programming/modeling languages. Here's some examples: - https://github.com/microsoft/guidance - https://github.com/NVIDIA/NeMo-Guardrails/ - https://github.com/r2d4/rellm -…
    comment by killthebuddha · 2023-06-07 · in Run and create custom ChatGPT-like bots with OpenChat
  5. …from LLMs. Have been using it for some side projects and it seems to work pretty reliably. [0] https://github.com/microsoft/guidance
    comment by Ilasky · 2023-06-01 · in Show HN: TodoBot is an AI coach that helps you write a better todo list
  6. …people bother to learn it -- but it will cut out the time it takes to scaffold an application. [0] https://github.com/microsoft/guidance
    comment by lcnPylGDnU4H9OF · 2023-05-25 · in Lessons from Creating a VSCode Extension with GPT-4
  7. …testers/testing data) on what people want, and looking for prompts/chat logs/guidance templates ( https://github.com/microsoft/guidance ) for tasks they expect to "just work" with natural language. Instead of being limited by the…
    comment by srslack · 2023-05-24 · in QLoRA: Efficient Finetuning of Quantized LLMs
  8. ▲ 1
    Ask HN: Is it appropriate to use a semantic cache in Microsoft Guidance?
    story by SimFG · 2023-05-24 · 0 comments
  9. …and used by other algorithms is very important, see GPT's "system prompt", Microsoft Guidance ( https://github.com/microsoft/guidance ) and other tools and discussions. But you probably won't hear much about AI alignment itself, except…
    comment by armchairhacker · 2023-05-20 · in Ask HN: How is “AI Alignment” currently being(treated/discussed/eval'd) on HN?
  10. …ecosystem on a possibly overly-complicated first pass solution to the orchestration problem. [0] https://github.com/microsoft/guidance
    comment by chatmasta · 2023-05-19 · in LangChain: The Missing Manual
  11. …doesn't match GPT-3.5 elsewhere IMO, even though GPT-3.5 is also not great at complex tasks. [0]: https://github.com/microsoft/guidance/blob/main/notebooks/ch...
    comment by whimsicalism · 2023-05-19 · in Apple Restricts Employee Use of ChatGPT, Joining Other Companies Wary of Leaks
  12. ▲ 4
    ChatGPT vs. open source (Vicuna and MPT) on harder tasks
    story by wg337 · 2023-05-19 · 0 comments
  13. For some reason the link now leads to a 404. Stable link: https://github.com/microsoft/guidance/blob/8677f3aa269e05ecb... Commit that removed the notebook: https://github.com/microsoft/guidance/commit/b91d332f49a55ed...
    comment by hrpnk · 2023-05-19 · in ChatGPT vs. open source on harder tasks
  14. It’s not deleted… https://github.com/microsoft/guidance/blob/8677f3aa269e05ecb...
    comment by hm-nah · 2023-05-19 · in ChatGPT vs. open source on harder tasks
  15. The author deleted it. Maybe dang could update the link? The last commit before that: https://github.com/microsoft/guidance/blob/8677/notebooks/ch... / https://archive.md/rGdnw
    comment by zebracanevra · 2023-05-19 · in ChatGPT vs. open source on harder tasks
  16. Here is one difference, token healing: https://github.com/microsoft/guidance#token-healing-notebook
    comment by verdverm · 2023-05-18 · in ChatGPT vs. open source on harder tasks
  17. ▲ 165
    ChatGPT vs. open source on harder tasks
    story by andy_xor_andrew · 2023-05-18 · 68 comments
  18. What's with all these weird-looking projects with similar names using Guidance? https://github.com/microsoft/guidance/network/dependents They don't even appear to be using Guidance anywhere anyway https://github.com/IFIF3526/aws-memo-server…
    comment by EddieEngineers · 2023-05-16 · in A guidance language for controlling LLMs
  19. …I understand the benefit of using a Handlebars-like DSL here. For example, given this code from https://github.com/microsoft/guidance/blob/main/notebooks/ch... create_plan = guidance('''{{#system~}} You are a helpful assistant.…
    comment by simonw · 2023-05-16 · in A guidance language for controlling LLMs
  20. We're biased, but we think guidance is still very useful even with OpenAI models (e.g. in https://github.com/microsoft/guidance/blob/main/notebooks/ch... we use GPT-4 to do a bunch of stuff). We wrote a bit about the tradeoff between model…
    comment by marcotcr · 2023-05-16 · in A guidance language for controlling LLMs
  21. ▲ 552
    A guidance language for controlling LLMs
    story by evanmays · 2023-05-16 · 190 comments
  22. ▲ 3
    Microsoft/guidance: A guidance language for controlling large language models
    story by behnamoh · 2023-05-09 · 0 comments