TheTom/turboquant_plus
View on GitHub ↗ ★ 7,024 Python
3 mentions on Hacker News by 2 people: 2 stories, 1 comment · first 2026-03-27 · latest 2026-04-03
20082026
-
…no training, just quantize and go. If anyone is running local LLMs and wants to try it: https://github.com/TheTom/turboquant_plus/blob/main/docs/get...
comment by pidtom · 2026-04-03 · in Show HN: TurboQuant for vector search – 2-4 bit compression -
▲ 4
Solo dev creates Open Source Turboquantstory by nico · 2026-03-30 · 2 comments
-
▲ 1
Skipping 90% of KV dequant work speeds up LLM decode by 22%story by pidtom · 2026-03-27 · 0 comments