1rgs/jsonformer
View on GitHub ↗ ★ 4,938 Jupyter Notebook
A Bulletproof Way to Generate Structured JSON from Language Models
17 mentions on Hacker News by 15 people: 2 stories, 15 comments · first 2023-05-02 · latest 2024-08-06
20082026
-
…actually, we do sort of know -- they call out jsonformer as an inspiration in the acknowledgements https://github.com/1rgs/jsonformer
comment by dilap · 2024-08-06 · in Structured Outputs in the API -
…tried them myself but they look very promising. [0]: https://github.com/outlines-dev/outlines [1]: https://github.com/1rgs/jsonformer
comment by Hugsun · 2023-12-25 · in Ask HN: How do I train a custom LLM/ChatGPT on my own documents in Dec 2023? -
…with "As a large language model...", especially with uncensored models. - Tools like jsonformer https://github.com/1rgs/jsonformer are not possible with OpenAIs API. - It's also just really cool, let's be honest.
comment by notsylver · 2023-09-04 · in Refact Code LLM: 1.6B LLM for code that reaches 32% HumanEval -
How does this compare in terms of latency, cost, and effectiveness to jsonformer? https://github.com/1rgs/jsonformer
comment by leetharris · 2023-08-14 · in Show HN: LLMs can generate valid JSON 100% of the time -
I'm not sure how this is different than: https://github.com/1rgs/jsonformer or https://github.com/newhouseb/clownfish or https://github.com/mkuchnik/relm or https://github.com/ggerganov/llama.cpp/pull/1773 or…
comment by BoorishBears · 2023-08-14 · in Show HN: LLMs can generate valid JSON 100% of the time -
…to respond with only "yes" or "no", I recommend looking into how the jsonformers library works: https://github.com/1rgs/jsonformer . Essentially, you still let the model generate many tokens for the next position, and only accept the ones…
comment by spikedoanz · 2023-08-09 · in Ask HN: Explain how size of input changes ChatGPT performance -
Jsonformer - https://github.com/1rgs/jsonformer-claude , https://github.com/1rgs/jsonformer
comment by yunyu · 2023-07-31 · in A framework to securely use LLMs in companies – Part 1: Overview of Risks -
…getting anywhere, it can show the user its attempts (in case they give the user any idea). [0] https://github.com/1rgs/jsonformer
comment by skissane · 2023-07-05 · in Tips for programmers to stay ahead of generative AI -
…allowed characters and truncate if needed. It’s pretty efficient, there’s an implementation here: https://github.com/1rgs/jsonformer
comment by yunyu · 2023-06-15 · in Native JSON Output from GPT-4 -
This is the best implementation I've seen, but only for Hugging Face models: https://github.com/1rgs/jsonformer
comment by DougBTX · 2023-06-15 · in Native JSON Output from GPT-4 -
…implemented this for JSON Schema (limited subset) on llama.cpp. See also e.g. this implementation: https://github.com/1rgs/jsonformer
comment by misterdata · 2023-06-13 · in Function calling and other API updates -
…Guidance then takes over again to finish the blob { "name": "bob", "job": "programmer" } [1] https://github.com/1rgs/jsonformer https://github.com/newhouseb/clownfish Note: guidance is way more general of a tool than these Edit: spacing
comment by evanmays · 2023-05-16 · in A guidance language for controlling LLMs -
…positives or to task boundaries. There’s also RHLF-derived coercion which is hilarious. [2] [0] https://github.com/1rgs/jsonformer [1] https://news.ycombinator.com/item?id=35790092 [2] https://twitter.com/goodside/status/1657396491676164096
comment by wll · 2023-05-13 · in Prompt injection explained, with video, slides, and a transcript -
Ah, this one: https://github.com/1rgs/jsonformer
comment by m3kw9 · 2023-05-05 · in Show HN: GPT-JSON – Structured and typehinted GPT responses in Python