RightNow-AI/local-kimi
View on GitHub ↗ ★ 45 Python
Optimized local serving engine for Kimi-Linear-48B: INT4 quantizer, fused decode kernels for a measured 3.18x, and an OpenAI-compatible server. Ships with k3, a bridge that detects the client per request so Claude Code, Codex, Cline, Aider and opencode all work unchanged.
3 mentions on Hacker News by 3 people: 1 story, 2 comments · first 2026-07-29 · latest 2026-08-01
20082026
-
…[ok] 29 Jul 2026 02:01:04 UTC Kimi K3 running on any device locally https://github.com/RightNow-AI/local-kimi https://news.ycombinator.com/item?id=49092591 [dead] 29 Jul 2026 13:49:32 UTC Show HN: Waste Run the full 2.78T-para
comment by 1vuio0pswjnm7 · 2026-08-01 · in Run Kimi K3 using 29 GB of RAM at 0.50 tok/s -
▲ 4
Kimi k3 run on RTX 5090story by OsamaJaber · 2026-07-30 · 0 comments
-
…- July 2026 https://x.com/Akashi203/status/2082555972380401852 https://github.com/RightNow-AI/local-kimi
comment by toomuchtodo · 2026-07-29 · in Trump administration bans new Chinese humanoid robots