getumbrel/llama-gpt
View on GitHub ↗ ★ 10,924 TypeScript
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
6 mentions on Hacker News by 6 people: 1 story, 5 comments · first 2023-08-16 · latest 2025-12-15
20082026
-
…democratizes access to AI, allowing you to run powerful models on a device you own and control. 0: https://github.com/getumbrel/llama-gpt?tab=readme-ov-file#be...
comment by evil-olive · 2025-12-15 · in Umbrel – Personal Cloud -
How does this compare with https://github.com/getumbrel/llama-gpt ?
comment by walth · 2023-09-19 · in Show HN: macOS GUI for running LLMs locally -
wodner if you can pair with https://github.com/getumbrel/llama-gpt
comment by vanillax · 2023-08-28 · in Continue with LocalAI: An alternative to GitHub's Copilot that runs locally -
I put up a draft PR to demo how to run it on a GPU: https://github.com/getumbrel/llama-gpt/pull/11 It breaks other things like model downloading, but once I got it to a working state for myself, I figured why not put it up there in case…
comment by dicriseg · 2023-08-17 · in Show HN: LlamaGPT – Self-hosted, offline, private AI chatbot, powered by Llama 2 -
…this with a GPU? If so what do I need to change? Seems like it's hardcoded to 0 in the run script: https://github.com/getumbrel/llama-gpt/blob/master/api/run.s...
comment by belval · 2023-08-16 · in Show HN: LlamaGPT – Self-hosted, offline, private AI chatbot, powered by Llama 2 -
▲ 225
Show HN: LlamaGPT – Self-hosted, offline, private AI chatbot, powered by Llama 2story by mayankchhabra · 2023-08-16 · 75 comments