tonbistudio/turboquant-pytorch
View on GitHub ↗ ★ 1,048 Python
From-scratch PyTorch implementation of Google's TurboQuant (ICLR 2026) for LLM KV cache compression. 5x compression at 3-bit with 99.5% attention fidelity.
3 mentions on Hacker News by 3 people: 1 story, 2 comments · first 2026-03-25 · latest 2026-04-03
20082026
-
▲ 2
10-19x faster alternative to TurboQuant via Clifford rotors (44x fewer params)story by hochmartinez · 2026-04-03 · 0 comments
-
…law is load-bearing infrastructure for the software industry or for open source software. [1] https://github.com/tonbistudio/turboquant-pytorch
comment by skybrian · 2026-03-27 · in Some uncomfortable truths about AI coding agents -
And a group has published an independent working implementation today, nice to see: https://github.com/tonbistudio/turboquant-pytorch
comment by pstoll · 2026-03-25 · in TurboQuant: Redefining AI efficiency with extreme compression