vasi/pixz
View on GitHub ↗ ★ 794 C
Parallel, indexed xz compressor
14 mentions on Hacker News by 10 people: 1 story, 13 comments · first 2010-06-24 · latest 2026-01-25
20082026
-
Besides `ar` as a sibiling observed, you might also be thinking of pixz - https://github.com/vasi/pixz , but really any archive format (cpio, etc.) can, in principle, just put a stake in the ground to have its last file be any kind of…
comment by cb321 · 2026-01-25 · in I built a 2x faster lexer, then discovered I/O was the real bottleneck -
That's really confusing since `pixz` exists and its "pixie" pronunciation actually works https://github.com/vasi/pixz
comment by nammi · 2023-05-12 · in Pigz: Parallel gzip for modern multi-processor, multi-core machines -
pixz ( https://github.com/vasi/pixz ) is a nice parallel xz that additionally creates an index of tar files so you can decompress individual files. I wonder if dpkg could be extended to do something similar.
comment by jks · 2022-07-24 · in Xz format considered inadequate for long-term archiving (2016) -
Related: pixz – a variant of xz that works with tar and enables (semi)efficient random access: https://github.com/vasi/pixz
comment by nathell · 2021-11-10 · in Hop: Faster than unzip and tar at reading individual files -
…relevant is pixz [1] which can do parallel LZMA/XZ decompression as well as tar file indexing. [1] https://github.com/vasi/pixz
comment by cb321 · 2021-11-10 · in Hop: Faster than unzip and tar at reading individual files -
Also https://github.com/vasi/pixz , which uses a more computationally efficient yet widely supported compression algorithm (lzma/xz) and adds indexing, making byte range access possible in large files within the archive (and does also…
comment by ak217 · 2020-07-12 · in Parallel Gzip – Pigz -
For general purposes, I like using pixz which is indexable in comparison: https://github.com/vasi/pixz Do you know if Debian is using parallelized XZ or not with apt / dpkg?
comment by shmerl · 2020-01-05 · in Now using Zstandard instead of xz for package compression -
And the same for LZMA: https://github.com/vasi/pixz (it's relatively easy to remember those commands)
comment by tobias3 · 2016-08-20 · in A parallel implementation of gzip for modern multi-processor multi-core machines -
…XZ compression/expansion tool. I find it indispensable for logs and database backups. Link: https://github.com/vasi/pixz Fish shell users can take advantage of the Extract and Compress plugins I wrote, which utilize Pixz if installed:…
comment by justinmayer · 2015-12-12 · in Stop using gzip -
…https://hackercodex.com/guide/parallel-bzip-compression/ That said, parallel XZ is even better: https://github.com/vasi/pixz
comment by justinmayer · 2015-12-12 · in Stop using gzip -
lzma parallelizes very well! My implementation of parallel xz ( https://github.com/vasi/pixz ) works quite well. There are others as well, including pxz and the alpha version of the standard xz. All these tools produce compressed files…
comment by vasi · 2013-12-28 · in Happy new year and goodbye bzip2 -
I've also got my version of parallel xz: https://github.com/vasi/pixz It doesn't require use of large temporary files like pxz, and the xz files it produces can also be decompressed in parallel.
comment by vasi · 2012-05-30 · in Massive Speed Gains via Parallelized BZIP2 Compression