pkolaczk/fclones
View on GitHub ↗ ★ 2,983 Rust
Efficient Duplicate File Finder
15 mentions on Hacker News by 12 people: 6 stories, 9 comments · first 2020-06-09 · latest 2026-07-26
20082026
-
imo fclones is the one to beat, https://github.com/pkolaczk/fclones#benchmarks nice that there are actually some ok interfaces here. with fclones, i tend to generate a file of candidates then do a little review to make super certain…
comment by jauntywundrkind · 2026-07-26 · in DskDitto: Ultra-fast, parallel duplicate-file detector -
I've been using `fclones` [1] to do this, with `dedupe`, which uses reflink/clonefile. https://github.com/pkolaczk/fclones
comment by zerd · 2025-02-25 · in Hyperspace -
…same command[1]: if cfg!(target_os = "macos") { result.push(format!("cp -c {target} {link}")); [1] https://github.com/pkolaczk/fclones/blob/555cde08fde4e700b25...
comment by PenguinRevolver · 2025-02-25 · in Hyperspace -
https://github.com/pkolaczk/fclones can do the same thing, and it's perfectly free and open source. terminal based though
comment by siranachronist · 2025-02-25 · in Hyperspace -
For duplicate files I've used the following: - https://github.com/adrianlopezroche/fdupes - https://github.com/pkolaczk/fclones The latter works well for larger datasets, outputs a TXT which you can analyse and decide what to do with.
comment by wjdp · 2024-03-19 · in Ask HN: How should organize and back up 23 TiB of personal files? -
I would suggest using https://github.com/pkolaczk/fclones instead. It's way faster.
comment by frankjr · 2023-11-02 · in Fdupes: Identify or delete duplicate files -
…are not modified I think?). It looks like fclones implements this, is faster and is written in Rust https://github.com/pkolaczk/fclones (the last is the most important point of course /s).
comment by anewhnaccount2 · 2023-01-26 · in Pip and cargo are not the same -
…but things like benchmarking tools, webservers or even duplicate file finders (shameless plug: https://github.com/pkolaczk/fclones#benchmarks - there is one Java app there, see its memory use :D)
comment by pkolaczk · 2021-11-24 · in GC progress from JDK 8 to JDK 17 -
See also fclones (focuses on performance, has benchmarks https://github.com/pkolaczk/fclones ). I didn't know about rdfind but thought the standard was fdupes https://github.com/adrianlopezroche/fdupes , which is as fast (or slow) as…
comment by artemisart · 2021-08-30 · in Go Find Duplicates: A fast and simple tool to find duplicate files