Hacker GitHub

← All repos

powturbo/TurboPFor-Integer-Compression

View on GitHub ↗ ★ 850 C

Fastest Integer Compression

18 mentions on Hacker News by 2 people: 9 stories, 9 comments · first 2014-10-29 · latest 2023-06-25

Mentions per year 18 mentions · busiest year 2019 (6)
20082026
  1. …1GB/s in decompression, wherea TurboPFor is in the order of 10Gb/s, TurboBitByte is >100Gb/s. -[1] https://github.com/powturbo/TurboPFor-Integer-Compression -[2] https://www.vldb.org/pvldb/vol8/p1816-teller.pdf -[3]…
  2. …several times (>100GB/s see TurboBitByte in [2]) faster than general purpose compressors. [1] - https://github.com/powturbo/TurboPFor-Integer-Compression [2] - https://github.com/powturbo/TurboPFor-Integer-Compression/is...
    comment by powturbo · 2023-06-06 · in Iguana: fast SIMD-optimized decompression
  3. …szenarios, using 32-bits instead of 64-bits floating point data like in the benchmark above. [1] https://github.com/powturbo/TurboPFor-Integer-Compression [2] https://github.com/powturbo/TurboPFor-Integer-Compression/is... [3]…
  4. …not work with other datasets. Download icapp from [3] and make your own tests with your data. [1] https://github.com/powturbo/TurboPFor-Integer-Compression [2] https://github.com/powturbo/TurboPFor-Integer-Compression/is... [3]…
    comment by powturbo · 2023-04-19 · in Float Compression 9: Lzsse and Lizard
  5. …in the TurboPFor [1] demo. TurboPFor offers also direct access to single values in a block. 1 - https://github.com/powturbo/TurboPFor
  6. …bit ops like ctz and bit shifting. That's decoding The fastest elias-fano implementation is in https://github.com/powturbo/TurboPFor and is partially using SIMD
  7. …algorithm is not helping so much. You can do your own benchmarks with your data with TurboPFor : https://github.com/powturbo/TurboPFor or download icapp including more powerfull algorithms.
  8. 1 - [TurboPFor]( https://github.com/powturbo/TurboPFor ) 2 - [TurboPFor: an analysis]( https://michael.stapelberg.ch/posts/2019-02-05-turbopfor-ana... ) 3 - [Debian Code Search:Website]( https://github.com/Debian/dcs/ ) 4 - [Debian Code…
  9. libfor benchmarked: https://github.com/powturbo/TurboPFor