adrianlopezroche/fdupes
View on GitHub ↗ ★ 3,034 C
FDUPES is a program for identifying or deleting duplicate files residing within specified directories.
10 mentions on Hacker News by 10 people: 3 stories, 7 comments · first 2014-09-01 · latest 2025-04-05
20082026
-
…- https://codeberg.org/jbruchon/jdupes / https://www.jdupes.com/ - https://github.com/adrianlopezroche/fdupes - https://github.com/pauldreik/rdfind
comment by nikisweeting · 2024-10-31 · in OpenZFS deduplication is good now and you shouldn't use it -
For duplicate files I've used the following: - https://github.com/adrianlopezroche/fdupes - https://github.com/pkolaczk/fclones The latter works well for larger datasets, outputs a TXT which you can analyse and decide what to do with.
comment by wjdp · 2024-03-19 · in Ask HN: How should organize and back up 23 TiB of personal files? -
I like fdupes/jdupes for finding duplicate files: https://github.com/adrianlopezroche/fdupes https://github.com/jbruchon/jdupes
comment by pabs3 · 2022-11-12 · in Ask HN: Tool to find identical file subtrees scattered over disks -
I do this, alongside a tool for finding duplicate files: https://github.com/adrianlopezroche/fdupes .
comment by sasl · 2022-01-18 · in Ask HN: What is your system for backing up family photos and video? -
…). I didn't know about rdfind but thought the standard was fdupes https://github.com/adrianlopezroche/fdupes , which is as fast (or slow) as rdfind according to fclones (and fclones is much faster).
comment by artemisart · 2021-08-30 · in Go Find Duplicates: A fast and simple tool to find duplicate files -
fdupes -rL /dir see also jdupes fork of fdupes https://github.com/jbruchon/jdupes https://github.com/adrianlopezroche/fdupes
comment by nabla9 · 2017-02-03 · in LCFS: A New Container Filesystem for Modern Datacenters -
…out dupes by other tricks like partial hashes etc., so you can avoid hashing some of the files. [1] https://github.com/adrianlopezroche/fdupes Edit: just noticed that it's using md5, which is broken [2], and that it's using truncated md5…
comment by kardos · 2016-11-27 · in Rename files to match hash of contents