Hacker GitHub

← All repos

cnygaard/glq

View on GitHub ↗ ★ 8 Python

Lattice and trellis-coded quantization for LLM weights — 2–8 bpw, mixed-precision, fused CUDA tensor-core inference on vLLM + HF

4 mentions on Hacker News by 1 person: 2 stories, 2 comments · first 2026-06-01 · latest 2026-09-10

Mentions per year 4 mentions · busiest year 2026 (4)
20082026
AllStoriesComments NewestTopOldest
  1. …trellis + computed Gaussian code 4. Decode — stateless bit-shift arithmetic, fused into matmul https://github.com/cnygaard/glq/blob/main/docs/trellis-3inst... glq comes with a user friendly installer which installs glq, vLLM and gradio…
    comment by acd · 2026-09-10 · in Glq a port trellis quantization of large language models as a vLLM plugin
  2. …and ai developer I want to squeeze more out of the same hardware. Glq runs with vLLM. Open source https://github.com/cnygaard/glq Pypi glq https://pypi.org/project/glq/
    comment by acd · 2026-08-18 · in Memory prices climb 500% in 12 months