Hacker GitHub

← All repos

fake-name/IntraArchiveDeduplicator

View on GitHub ↗ ★ 108 Python

Tool for managing data-deduplication within extant compressed archive files, along with a relatively performant BK tree implementation for fuzzy image searching.

3 mentions on Hacker News by 1 person: 0 stories, 3 comments · first 2016-08-24 · latest 2017-06-22

Mentions per year 3 mentions · busiest year 2017 (2)
20082026
AllStoriesComments NewestTopOldest
  1. …already: https://github.com/fake-name/ReadableWebProxy https://github.com/fake-name/AutoTriever https://github.com/fake-name/IntraArchiveDeduplicator https://github.com/fake-name/MangaCMS https://github.com/fake-name/DanbooruScraper…
    comment by fake-name · 2017-06-22 · in Verizon is killing Tumblr’s fight for net neutrality
  2. …C++ + Cython implementation of a BK-tree that I use for large-scale image deduplication on github: https://github.com/fake-name/IntraArchiveDeduplicator/tree/m... The core is a single, header-only BK-tree implementation here:…
    comment by fake-name · 2017-04-03 · in Interesting data structures: the BK-tree
  3. …full sized. 3. I don't have a phash-based fuzzy image deduplication system on top of all this (see https://github.com/fake-name/IntraArchiveDeduplicator ). It's main purpose is to deduplicate manga ( https://github.com/fake-name/MangaCMS ).
    comment by fake-name · 2016-08-24 · in Web Scraping in 2016