Hacker GitHub

← All repos

henk717/KoboldAI

View on GitHub ↗ ★ 439 C++

KoboldAI is generative AI software optimized for fictional use, but capable of much more!

3 mentions on Hacker News by 3 people: 0 stories, 3 comments · first 2023-03-12 · latest 2024-01-02

Mentions per year 3 mentions · busiest year 2023 (2)
20082026
AllStoriesComments NewestTopOldest
  1. …There are a lot of unaligned models available, and user interfaces that aren’t that hard to use. https://github.com/henk717/KoboldAI
    comment by fnordpiglet · 2024-01-02 · in AI generated security reports about curl
  2. …with the very fast and vram-efficient exllamav2 backend: https://github.com/LostRuins/koboldcpp https://github.com/henk717/KoboldAI - Hosts pick a quantized community LLM to run, which is (IMO) the real magic of this system. Cloud services…
    comment by brucethemoose2 · 2023-10-09 · in Chat with, and help host, a free community LLM "horde"
  3. …Ooba's textgen webui runs LLaMA 4bit on 8GB VRAM consumer video cards. KoboldAI ( https://github.com/henk717/KoboldAI/ ) by the creator the AI Horde of stable diffusion fame also supports LLaMA and has forked the Stable Horde for textgen. C
    comment by MacsHeadroom · 2023-03-12 · in Large language models are having their Stable Diffusion moment