Hacker GitHub

← All repos

meta/zstd

View on GitHub ↗ ★ 28,151 C

Zstandard - Fast real-time compression algorithm

165 mentions on Hacker News by 112 people: 28 stories, 137 comments · first 2016-08-31 · latest 2026-09-07

Mentions per year 165 mentions · busiest year 2018 (27)
20082026
AllStoriesComments NewestTopOldest
  1. …should take exactly as much time as it takes to download the file via stream processing. Also: https://github.com/facebook/zstd ; better ratios, better speed.
    comment by dpc_pw · 2018-10-26 · in Parsing logs 230x faster with Rust
  2. The commit that dual-licensed under BSD and GPLv2 also "removed PATENTS clause": https://github.com/facebook/zstd/commit/4f73b3b55d83b082aad1...
    comment by electrum · 2018-10-03 · in Zstandard Compression and the application/zstd Media Type
  3. …git repositories had a patent "grant" document, there was some angst about what exactly this meant: https://github.com/facebook/zstd/issues/335 -- this was considered "resolved" when facebook decided to distribute the software under GPLv2,…
    comment by jepler · 2018-10-03 · in Zstandard Compression and the application/zstd Media Type
  4. …(unlike gzip) lets you set your window to be GBs if you want (look for "long-range match finder" in https://github.com/facebook/zstd/releases if you want more context); those window sizes would, of course, not be ideal on a low-end…
    comment by twotwotwo · 2018-10-03 · in Zstandard Compression and the application/zstd Media Type
  5. …or have very cheap compression using its fastest modes (hundreds of MB/s/core; see --fast modes at https://github.com/facebook/zstd/releases/tag/v1.3.4 ). brotli especially helped at the high end (static stuff you'll serve many times and…
    comment by twotwotwo · 2018-10-03 · in Zstandard Compression and the application/zstd Media Type
  6. How about zstd? https://github.com/facebook/zstd
    comment by d33 · 2018-06-26 · in ‘You can't use Brotli for dynamic content’ and other misconceptions
  7. It is mentioned at the bottom of the README, but it isn't very findable. I've opened a PR https://github.com/facebook/zstd/pull/1085 .
    comment by terrelln · 2018-03-30 · in Zstandard v1.3.4 – faster everything
  8. …was added for inclusion in the kernel, you may choose either GPLv2 or BSD. See the header file https://github.com/facebook/zstd/blob/dev/lib/zstd.h .
    comment by terrelln · 2018-03-30 · in Zstandard v1.3.4 – faster everything
  9. The library is dual licensed under plain BSD [1] and GPLv2 [2]. [1] https://github.com/facebook/zstd/blob/dev/LICENSE [2] https://github.com/facebook/zstd/blob/dev/COPYING
    comment by terrelln · 2018-03-30 · in Zstandard v1.3.4 – faster everything
  10. …that covers the entire corpus. In real world use cases the compression ratio can go from 3x to 9x: https://github.com/facebook/zstd#the-case-for-small-data-com... What was the finality on the issue of patents with this library? Is there an…
    comment by koolba · 2018-03-30 · in Zstandard v1.3.4 – faster everything
  11. …ratios. It's backed by a very fast entropy stage, provided by Huff0 and FSE library." 1: https://github.com/facebook/zstd
    comment by portmanteaufu · 2018-03-30 · in Zstandard v1.3.4 – faster everything
  12. …https://github.com/t3rmin4t0r/orc/tree/zstd [1] - https://issues.apache.org/jira/browse/ORC-46 [2] - https://github.com/facebook/zstd/issues/775
    comment by gopalv · 2018-01-25 · in Zstandard – Real-time data compression algorithm
  13. …yet. Does anyone know any better? It seems like we could use a better alternative to Snappy. [1] https://github.com/facebook/zstd/issues/395
    comment by lars_francke · 2018-01-25 · in Zstandard – Real-time data compression algorithm
  14. …the patents clause [1] and GPLv2 [2]. GPLv2 was added for inclusion in the Linux kernel. [1] https://github.com/facebook/zstd/blob/dev/LICENSE [2] https://github.com/facebook/zstd/blob/dev/COPYING
    comment by terrelln · 2018-01-25 · in Zstandard – Real-time data compression algorithm
  15. …with `zstd --long` for a 128 MB window, or `--long=windowLog` for a `2^windowLog` byte window. [1] https://github.com/facebook/zstd/releases/tag/v1.3.2
    comment by terrelln · 2018-01-25 · in Zstandard – Real-time data compression algorithm
  16. …$ time cat linux-4.14-rc6.tar.zst | zstd -d > out2 real 0m1.702s user 0m1.220s sys 0m0.520s [0]: https://github.com/facebook/zstd/blob/dev/doc/images/DCspeed...
    comment by Iburinoc · 2017-10-24 · in An ode to pack: gzip’s forgotten decompressor
  17. …the the normal zstd decompressor. There is a short article about it in the latest release notes https://github.com/facebook/zstd/releases/tag/v1.3.2
    comment by terrelln · 2017-10-23 · in An ode to pack: gzip’s forgotten decompressor
  18. They dual licensed under BSD and GPLv2: https://github.com/facebook/zstd/issues/335#issuecomment-323... I expect they did a thorough analysis to work out if any of it was either already patented, or patentable. That doesn't mean they don't…
    comment by Flenser · 2017-09-18 · in On React and WordPress
  19. Interestingly, Facebook did remove its PATENTS clause on another project they have recently - zstd - https://github.com/facebook/zstd/pull/801
    comment by 0x0 · 2017-09-15 · in On React and WordPress
  20. …length, match length, offset) triples. [1] https://github.com/Cyan4973/FiniteStateEntropy [2] https://github.com/facebook/zstd/blob/dev/doc/zstd_compressi...
    comment by terrelln · 2017-08-22 · in Understanding Asymmetric Numeral Systems
  21. …opinion and leave your comment on the thread which discusses the license change over on GitHub? https://github.com/facebook/zstd/issues/775
    comment by markyuckerberg · 2017-08-19 · in Explaining React's license
  22. I am very happy to report that ZSTD removed PATENTS clause: https://github.com/facebook/zstd/pull/801
    comment by sanxiyn · 2017-08-19 · in Explaining React's license
  23. …thing. There is an issue with a related discussion about it going for more than a year: https://github.com/facebook/zstd/issues/335 Last update is interesting. Someone did a search and looked for any patents FB filed for and couldn't find…
    comment by rdtsc · 2017-07-16 · in Apache Foundation disallows use of the Facebook “BSD+Patent” license
  24. …any Patent Assertion: (i) against Facebook or any of its subsidiaries or corporate affiliates... https://github.com/facebook/zstd/blob/dev/PATENTS
    comment by dmit · 2017-04-09 · in Performance of Solaris' ZFS LZ4 Compression
  25. …is an ongoing discussion about a jump table format that could contain dictionary locations [1]. [1] https://github.com/facebook/zstd/issues/395
    comment by terrelln · 2017-04-07 · in Deploying Brotli for static content
  26. It depends on the "window size" used by the compressor. According to https://github.com/facebook/zstd/blob/dev/doc/zstd_compressi... , the window size can be anywhere from 1KB to 1.875TB. The table mapping compression levels to window…
    comment by indygreg2 · 2017-03-07 · in Better Compression with Zstandard
  27. How does that play with BSD license file which presumably has no such restrictions: https://github.com/facebook/zstd/blob/dev/LICENSE
    comment by koolba · 2017-03-07 · in Better Compression with Zstandard
  28. …zstd is probably one of the most exciting new developments in compression. However this worries me: https://github.com/facebook/zstd/blob/dev/PATENTS --- The license granted hereunder will terminate [...] if you [...] initiate [...] any…
    comment by rdtsc · 2017-03-07 · in Better Compression with Zstandard
  29. Looks like they're using the BSD license in this project, https://github.com/facebook/zstd/blob/dev/LICENSE So no need to worry about the patent clause in this case right?
    comment by jontro · 2017-02-06 · in Intern Impact: Brotli compression for Play Store app downloads
  30. …with both its speed and compression ratio. The days of "just use zLib" are coming to a close. [1]: https://github.com/facebook/zstd
    comment by jdcarter · 2017-02-06 · in Intern Impact: Brotli compression for Play Store app downloads
  31. …compression speed vs. compression ratio. Decompressing is always fast. It was recently released: https://github.com/facebook/zstd
    comment by jakozaur · 2017-01-06 · in Bitpacking and Compression of Sparse Datasets
  32. …wrong. They probably would've preferred to avoid the outdated links that this[0] proves this. [0]: https://github.com/facebook/zstd/pull/313
    comment by ktta · 2016-09-01 · in Smaller and faster data compression with Zstandard
  33. Brotli is available in this graph - https://github.com/facebook/zstd/blob/master/images/DCspeed5... This seems to be slightly old doc - from April.
    comment by jithesh · 2016-08-31 · in Smaller and faster data compression with Zstandard
  34. The README at https://github.com/facebook/zstd mentions brotli
    comment by justinsaccount · 2016-08-31 · in Smaller and faster data compression with Zstandard
  35. The format itself is documented ( https://github.com/facebook/zstd/blob/master/zstd_compressio... ) with the intention of other implementations and language bindings being readily available. We also have a zlib-compatible API for easier…
    comment by ctur · 2016-08-31 · in Smaller and faster data compression with Zstandard
  36. > the link attached says https://github.com/Cyan4973/zstd but then redirects to https://github.com/facebook/zstd . Anyone know why? I believe this is just GitHub's standard behavior when a repository is moved to another namespace. We…
    comment by CyberShadow · 2016-08-31 · in Smaller and faster data compression with Zstandard
  37. …link mentioned below, the link attached says https://github.com/Cyan4973/zstd but then redirects to https://github.com/facebook/zstd . Anyone know why? [0]: http://facebook.github.io/zstd/ EDIT: After a little bit of sleuthing, it looks…
    comment by ktta · 2016-08-31 · in Smaller and faster data compression with Zstandard