Hacker GitHub

← All repos

fast-pack/FastPFOR

View on GitHub ↗ ★ 979 C++

The FastPFOR C++ library: Fast integer compression

10 mentions on Hacker News by 8 people: 1 story, 9 comments · first 2012-09-12 · latest 2024-10-24

Mentions per year 10 mentions · busiest year 2012 (3)
20082026
AllStoriesComments NewestTopOldest
  1. …can't decide at all). And that's the problem. That's why I find it very difficult to trust it. [1] https://github.com/lemire/FastPFor/blob/52e45deeab9c3a481daa...
    comment by jcgrillo · 2024-10-24 · in Everything I built with Claude Artifacts this week
  2. …count)) } What even is going on here? Compare to an actually sane implementation like[1] or[2]. [1] https://github.com/lemire/FastPFor/blob/master/headers/simpl... [2] https://github.com/timescale/timescaledb/blob/403782a5899c75...
    comment by jcgrillo · 2024-10-24 · in Everything I built with Claude Artifacts this week
  3. …you can store 1,2,3,4,5...10_000 in 2 bytes). But for other integer datasets there's FastPFOR https://github.com/lemire/FastPFor The linked papers there will talk about techniques that can be used to store multiple 32bit integers into a…
    comment by insanitybit · 2023-10-17 · in Making CRDTs More Efficient
  4. …[2] https://en.wikipedia.org/wiki/Variable-length_quantity#Zigza... [3] https://github.com/lemire/FastPFor [4] https://github.com/searchivarius/PyFastPFor [5] https://github.com/naturalplasmoid/simple8b-timeseries-compr...
    comment by naturalplasmoid · 2022-05-14 · in Time-Series Compression Algorithms
  5. …per second through vectorization https://onlinelibrary.wiley.com/doi/full/10.1002/spe.2203 [2] https://github.com/lemire/FastPFor [3] https://github.com/searchivarius/PyFastPFor
    comment by criticaltinker · 2021-08-21 · in The big-load anti-pattern
  6. Have you considered other integer compression algorithms like https://github.com/lemire/FastPFor ?
    comment by kochetovnicolai · 2019-06-25 · in How to speed up LZ4 decompression
  7. The repeated patterns in the SIMD implementation (see https://github.com/lemire/FastPFor/blob/master/src/bitpacksi... ) seem like they're dying for some simplification via macros. I can't imagine trying to spot a bug or typo in an…
    comment by kevingadd · 2012-09-12 · in Fast integer compression: decoding billions of integers per second
  8. It's buried in the article, but here's the paper: http://arxiv.org/abs/1209.2137 Here's the source: https://github.com/lemire/FastPFor
    comment by cube13 · 2012-09-12 · in Fast integer compression: decoding billions of integers per second
  9. …The word 'paper' is a link to http://arxiv.org/abs/1209.2137 and 'our software' is a link to https://github.com/lemire/FastPFor
    comment by kevingadd · 2012-09-12 · in Fast integer compression: decoding billions of integers per second