Hacker GitHub

← All repos

maheshvaikri-code/snapllm

View on GitHub ↗ ★ 43 C++

🔥 Alternative to Ollama — multi-model serving with sub-ms model switching · CPU-only 20B inference for Edge AI · llama.cpp + stablediffusion.cpp

3 mentions on Hacker News by 1 person: 1 story, 2 comments · first 2026-02-14 · latest 2026-02-15

Mentions per year 3 mentions · busiest year 2026 (3)
20082026
AllStoriesComments NewestTopOldest
  1. https://github.com/snapllm/snapllm
    comment by maheshvaikri99 · 2026-02-15 · in SnapLLM: Switch between local LLM in under 1ms Multi-model&-modal serving engine
  2. …the repo, downloading models from Hugging Face, and loading them through the UI. Links: GitHub: https://github.com/snapllm/snapllm Arxiv Paper: https://arxiv.org/submit/7238142/view Star this repository - It helps others discover SnapLLM…
    comment by maheshvaikri99 · 2026-02-14 · in SnapLLM: Switch between local LLM in under 1ms Multi-model&-modal serving engine