Hacker GitHub

← All repos

dropbox/hqq

View on GitHub ↗ ★ 963 Python

Official implementation of Half-Quadratic Quantization (HQQ)

3 mentions on Hacker News by 1 person: 0 stories, 3 comments · first 2023-12-07 · latest 2023-12-18

Mentions per year 3 mentions · busiest year 2023 (3)
20082026
AllStoriesComments NewestTopOldest
  1. …Shout-out to Artem Eliseev and Denis Mazur for suggesting this idea ( https://github.com/mobiusml/hqq/issues/2 )
    comment by ibuildthings · 2023-12-18 · in New Mixtral HQQ Quantzied 4-bit/2-bit configuration
  2. …of Mixtral utilizing the HQQ method that we just published https://mobiusml.github.io/hqq_blog/ and https://github.com/mobiusml/hqq . The 2-bit version can run on a 24GB Titan RTX. In terms of perplexity scores on the wikitext2 dataset,…
    comment by ibuildthings · 2023-12-11 · in 2-bit and 4-bit versions of Mixtral
  3. Sharing our work on model quantization. - Blog: https://mobiusml.github.io/hqq_blog/ - Code: https://github.com/mobiusml/hqq - Models: https://huggingface.co/mobiuslabsgmbh/ No data calibration needed, extremely fast , works on both…
    comment by ibuildthings · 2023-12-07 · in Half-Quadratic Quantization of Large Machine Learning Models