Hacker GitHub

← All repos

Vahe1994/SpQR

View on GitHub ↗ ★ 556 Python

4 mentions on Hacker News by 3 people: 1 story, 3 comments · first 2023-06-06 · latest 2024-03-08

Mentions per year 4 mentions · busiest year 2023 (3)
20082026
AllStoriesComments NewestTopOldest
  1. Found it from https://github.com/Vahe1994/SpQR Was somehow expecting it to be at https://github.com/TimDettmers/bitsandbytes . My bad.
    comment by AhtiK · 2024-03-08 · in Fine tune a 70B language model at home
  2. code here: https://github.com/Vahe1994/SpQR
    comment by homarp · 2023-06-11 · in SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression
  3. …sensitive weights with higher precision and roughly doubles improvements from GPTQ" Code here: https://github.com/Vahe1994/SpQR ( https://news.ycombinator.com/item?id=36219128 but no traction )
    comment by homarp · 2023-06-11 · in LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale (2022)