NVIDIA-NeMo/Guardrails
View on GitHub ↗ ★ 7,451 Python
NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
8 mentions on Hacker News by 8 people: 3 stories, 5 comments · first 2023-04-25 · latest 2023-09-05
20082026
-
…new programming/modeling languages. Here's some examples: - https://github.com/microsoft/guidance - https://github.com/NVIDIA/NeMo-Guardrails/ - https://github.com/r2d4/rellm - https://shreyar.github.io/guardrails/ - https://lmql.ai/ -…
comment by killthebuddha · 2023-06-07 · in Run and create custom ChatGPT-like bots with OpenChat -
Yes, this is feasible. Look into https://github.com/NVIDIA/NeMo-Guardrails and specifically to your question there are "topical rails" to ensure the conversation stays on a set of topics you greenlighted. Also takes care of jailbreaks and…
comment by experimenting · 2023-06-07 · in Run and create custom ChatGPT-like bots with OpenChat -
…to figure out who will be heading in the right direction. - https://shreyar.github.io/guardrails/ - https://github.com/NVIDIA/NeMo-Guardrails - https://www.askmarvin.ai/
comment by brianjking · 2023-05-21 · in LangChain: The Missing Manual -
Here's "jailbreak detection", in the NeMo-Guardrails project from Nvidia: https://github.com/NVIDIA/NeMo-Guardrails/blob/327da8a42d5f8... I.e. they ask the llm if the prompt will break the llm. (I believe that more data /some evaluation on…
comment by montebicyclelo · 2023-05-14 · in The Dual LLM pattern for building AI assistants that can resist prompt injection -
Thanks, I hadn't seen those. I did find https://github.com/NVIDIA/NeMo-Guardrails earlier but haven't looked into it yet. I'm not sure it solves the problem of restricting the information it uses though. For example, as a proof of concept…
comment by depr · 2023-05-08 · in RasaGPT: First headless LLM chatbot built on top of Rasa, Langchain and FastAPI