cnygaard/glq
View on GitHub ↗ ★ 8 Python
Lattice and trellis-coded quantization for LLM weights — 2–8 bpw, mixed-precision, fused CUDA tensor-core inference on vLLM + HF
4 mentions on Hacker News by 1 person: 2 stories, 2 comments · first 2026-06-01 · latest 2026-09-10
20082026
-
▲ 2
Glq a port trellis quantization of large language models as a vLLM pluginstory by acd · 2026-09-10 · 1 comment
-
▲ 2
Show HN: Glq LLM quantization using E8 latticestory by acd · 2026-06-01 · 0 comments