ronomon/deduplication
View on GitHub ↗ ★ 76 JavaScript
Fast multi-threaded content-dependent chunking deduplication for Buffers in C++ with a reference implementation in Javascript. Ships with extensive tests, a fuzz test and a benchmark.
3 mentions on Hacker News by 1 person: 2 stories, 1 comment · first 2017-08-17 · latest 2018-06-25
20082026
-
Have you considered content-dependent chunking for your deduplication? At Ronomon, we use https://github.com/ronomon/deduplication
comment by jorangreef · 2018-06-25 · in The Architecture of Mailinator (2007) -
▲ 2
Data deduplication for Node.jsstory by jorangreef · 2017-08-24 · 0 comments
-
▲ 2
Show HN: Fast multi-threaded content-defined chunking deduplication for Node.jsstory by jorangreef · 2017-08-17 · 0 comments