huawei-csl/KVarN

View on GitHub ↗ ★ 520 Python

KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag.

3 mentions on Hacker News by 3 people: 1 story, 2 comments · first 2026-06-04 · latest 2026-06-05

Mentions per year 3 mentions · busiest year 2026 (3)

20082026

All Stories Comments Newest Top Oldest

▲ 143
KVarN: Native vLLM backend for KV-cache quantization by Huawei
story by theanonymousone · 2026-06-04 · 16 comments