cnygaard/glq
View on GitHub ↗ ★ 8 Python
Lattice and trellis-coded quantization for LLM weights — 2–8 bpw, mixed-precision, fused CUDA tensor-core inference on vLLM + HF
4 mentions on Hacker News by 1 person: 2 stories, 2 comments · first 2026-06-01 · latest 2026-09-10
20082026
-
…trellis + computed Gaussian code 4. Decode — stateless bit-shift arithmetic, fused into matmul https://github.com/cnygaard/glq/blob/main/docs/trellis-3inst... glq comes with a user friendly installer which installs glq, vLLM and gradio…
comment by acd · 2026-09-10 · in Glq a port trellis quantization of large language models as a vLLM plugin -
▲ 2
Glq a port trellis quantization of large language models as a vLLM pluginstory by acd · 2026-09-10 · 1 comment
-
…and ai developer I want to squeeze more out of the same hardware. Glq runs with vLLM. Open source https://github.com/cnygaard/glq Pypi glq https://pypi.org/project/glq/
comment by acd · 2026-08-18 · in Memory prices climb 500% in 12 months -
▲ 2
Show HN: Glq LLM quantization using E8 latticestory by acd · 2026-06-01 · 0 comments