oobabooga/textgen
View on GitHub ↗ ★ 47,729 Python
Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.
131 mentions on Hacker News by 98 people: 7 stories, 124 comments · first 2023-02-26 · latest 2025-10-26
20082026
-
▲ 2
XTC: An LLM sampler that boosts creativity, breaks writing clichésstory by RicoElectrico · 2024-08-19 · 0 comments
-
▲ 1
QuIP#: SOTA 2-bit quantization method, now implemented in text-generation-webuistory by pyinstallwoes · 2023-12-04 · 0 comments
-
▲ 5
Show HN: Example POC to run the Dolly V2 12B model in 8bit modestory by freeqaz · 2023-04-14 · 0 comments
-
▲ 3
How to stop Vicuna talking to itselfstory by syntaxing · 2023-04-10 · 0 comments
-
▲ 2
Text Generation Web UIstory by songzme · 2023-03-29 · 0 comments
-
▲ 11
LLaMA Text-Generation-Webuistory by 0xbadc0de5 · 2023-03-10 · 6 comments
-
▲ 2
A gradio web UI for running Large Language Modelsstory by call-me-al · 2023-03-10 · 0 comments