serge-chat/serge
View on GitHub ↗ ★ 5,695 Svelte archived
A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.
4 mentions on Hacker News by 4 people: 1 story, 3 comments · first 2023-03-23 · latest 2023-05-04
20082026
-
…a docker image capable of the same as OpenAI in hetzner for 30 bucks a month I do exactly this with https://github.com/nsarrazin/serge Hetzner will install any hardware you send them for $100. So you can send them a $200 P40 24GB to run…
comment by MacsHeadroom · 2023-05-04 · in Google “We have no moat, and neither does OpenAI” -
…you are looking for? I've been using it to play around with prompting a few large language models. https://github.com/nsarrazin/serge
comment by NortySpock · 2023-05-04 · in SparseGPT: Language Models Can Be Accurately Pruned in One-Shot -
…this soon after release, but this will download and run the Ll*ma stuff with a decent web UI. [0] https://github.com/nsarrazin/serge
comment by smoldesu · 2023-04-23 · in Ask HN: Are there any ready-to-use Docker images for running LLMs locally? -
▲ 3
Serge: Web interface for Alpaca through llama.cpp. Fully Dockerizedstory by thunderbong · 2023-03-23 · 0 comments