Hacker GitHub

← All repos

mostlygeek/llama-swap

View on GitHub ↗ ★ 6,160 Go

Reliable model swapping for any local AI server. Chosen by thousands of users. Batteries included. If we don't have it, you probably don't need it.

8 mentions on Hacker News by 7 people: 1 story, 7 comments · first 2025-09-23 · latest 2026-08-12

Mentions per year 8 mentions · busiest year 2026 (5)
20082026
AllStoriesComments NewestTopOldest
  1. …I've been running flavors of OpenClaw and Hermes exclusively on local models hosted this way. https://github.com/mostlygeek/llama-swap
    comment by cptskippy · 2026-08-12 · in llama.cpp
  2. I use llama.cpp w/ llama-swap https://github.com/ggml-org/llama.cpp https://github.com/mostlygeek/llama-swap
    comment by computershit · 2026-08-10 · in Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows
  3. …https://www.reddit.com/r/LocalLLaMA/comments/1rhohqk/comment... And is in the sample config too: https://github.com/mostlygeek/llama-swap/blob/main/config.ex... iiuc MLX quants are not GGUFs for llama.cpp. They are a different file format…
    comment by suprjami · 2026-03-02 · in Qwen3.5 122B and 35B models offer Sonnet 4.5 performance on local computers
  4. …which provides a list of models and dynamically starts a llama-server process with the right model: https://github.com/mostlygeek/llama-swap (actually you could run any OpenAI-compatible server process with llama-swap)
    comment by suprjami · 2026-03-02 · in Qwen3.5 122B and 35B models offer Sonnet 4.5 performance on local computers
  5. https://github.com/mostlygeek/llama-swap
    comment by neilv · 2025-10-31 · in Ask HN: Who uses open LLMs and coding assistants locally? Share setup and laptop
  6. …llama.cpp directory whenever I want to update. 1: https://www.ycombinator.com/companies/ollama 2: https://github.com/mostlygeek/llama-swap
    comment by cristoperb · 2025-09-26 · in Ollama Web Search
  7. https://github.com/mostlygeek/llama-swap it's a transparent proxy that automatically launches your selected model with your preferred inference server so that you don't need to manually start/stop the server when you want to switch model…
    comment by elsombrero · 2025-09-23 · in 25L Portable NV-linked Dual 3090 LLM Rig