y-scope/clp
View on GitHub ↗ ★ 1,091 C++
Compressed Log Processor (CLP) is a free log management tool capable of compressing logs and searching the compressed logs without decompression.
5 mentions on Hacker News by 4 people: 1 story, 4 comments · first 2022-09-30 · latest 2026-02-27
20082026
-
…with a highly compressed representation? CLP can apparently achieve 169x compression ratio: https://github.com/y-scope/clp https://www.uber.com/blog/reducing-logging-cost-by-two-order...
comment by jcgrillo · 2026-02-27 · in We gave terabytes of CI logs to an LLM -
▲ 3
CLP: Compress Your Logs. Search Without Decompressionstory by ddmng · 2026-01-01 · 1 comment
-
https://github.com/y-scope/clp
comment by vdm · 2024-12-06 · in Lossless Log Aggregation – Reduce Log Volume by 99% Without Dropping Data -
…uncompressed size. For example, clp[1] can achieve much, much better compression on logs data. [1] https://github.com/y-scope/clp EDIT: See also[2][3]. [2] https://www.uber.com/blog/reducing-logging-cost-by-two-order... [3]…
comment by jcgrillo · 2024-07-11 · in Binance built a 100PB log service with Quickwit -
Original CLP Paper: https://www.usenix.org/system/files/osdi21-rodrigues.pdf Github project for CLP: https://github.com/y-scope/clp The interesting part about the article isn't that structured data is easier to compress and store, its that…
comment by twunde · 2022-09-30 · in Reducing logging cost by two orders of magnitude using CLP