gsuuon/ad-llama
View on GitHub ↗ ★ 51 TypeScript
Structured inference with Llama 2 in your browser
8 mentions on Hacker News by 1 person: 0 stories, 8 comments · first 2023-08-15 · latest 2024-07-08
20082026
-
This is (well -- ad-libs) what I based the name of my fill-in-the-blank-with-llm ts library on https://github.com/gsuuon/ad-llama/
comment by gsuuon · 2024-07-08 · in Reasoning in Large Language Models: A Geometric Perspective -
…logits before sampling. [1] https://github.com/ggerganov/llama.cpp#constrained-output-wi... [2] https://github.com/gsuuon/ad-llama (mine)
comment by gsuuon · 2023-10-06 · in Ask HN: Function Calling with Local LLMs? -
…a conversation, or an action json. And of course, no token limits since it runs client-side. [1] https://github.com/gsuuon/ad-llama [2] https://github.com/gsuuon/ad-llama/tree/murder-mystery-solid...
comment by gsuuon · 2023-09-20 · in Show HN: A murder mystery game built on an open-source gen-AI agent framework -
…biased sampling, I don't see how you can get it to continue a partially completed inference. [1] https://github.com/gsuuon/ad-llama
comment by gsuuon · 2023-09-17 · in Guidance: A guidance language for controlling large language models -
I'm hacking on a library ( https://github.com/gsuuon/ad-llama ) inspired by guidance, but in TS and for the browser. I think structured inference and controlled sampling are really good ways of getting consistent responses out of LLM's. It…
comment by gsuuon · 2023-09-16 · in Guidance: A guidance language for controlling large language models -
…occur to me that text-adventure game engines exist, I was apparently re-inventing the wheel. [1] https://github.com/gsuuon/ad-llama [2] https://ad-llama.vercel.app/murder/
comment by gsuuon · 2023-09-12 · in Simulating History with ChatGPT -
Yup, I'm building a library that runs LLM's in browser with tagged template literals: https://github.com/gsuuon/ad-llama I think it has fundamental DX benefits over python for complex prompt chaining (or I wouldn't be building it!) Even…
comment by gsuuon · 2023-08-30 · in Ask HN: Which programming language to learn in AI era? -
…a really interesting approach to guided sampling! I'm hacking on a structured inference library ( https://github.com/gsuuon/ad-llama ) - I also tried to add a vocab preprocessing step to generate a valid tokens mask (just with regex or…
comment by gsuuon · 2023-08-15 · in Show HN: LLMs can generate valid JSON 100% of the time