RightNow-AI/local-kimi
View on GitHub ↗ ★ 45 Python
Optimized local serving engine for Kimi-Linear-48B: INT4 quantizer, fused decode kernels for a measured 3.18x, and an OpenAI-compatible server. Ships with k3, a bridge that detects the client per request so Claude Code, Codex, Cline, Aider and opencode all work unchanged.
3 mentions on Hacker News by 3 people: 1 story, 2 comments · first 2026-07-29 · latest 2026-08-01
20082026
-
▲ 4
Kimi k3 run on RTX 5090story by OsamaJaber · 2026-07-30 · 0 comments