ronomon/deduplication

View on GitHub ↗ ★ 76 JavaScript

Fast multi-threaded content-dependent chunking deduplication for Buffers in C++ with a reference implementation in Javascript. Ships with extensive tests, a fuzz test and a benchmark.

3 mentions on Hacker News by 1 person: 2 stories, 1 comment · first 2017-08-17 · latest 2018-06-25

Mentions per year 3 mentions · busiest year 2017 (2)

20082026

All Stories Comments Newest Top Oldest

Have you considered content-dependent chunking for your deduplication? At Ronomon, we use https://github.com/ronomon/deduplication
comment by jorangreef · 2018-06-25 · in The Architecture of Mailinator (2007)