Hacker GitHub

← All repos

pkolaczk/fclones

View on GitHub ↗ ★ 2,983 Rust

Efficient Duplicate File Finder

15 mentions on Hacker News by 12 people: 6 stories, 9 comments · first 2020-06-09 · latest 2026-07-26

Mentions per year 15 mentions · busiest year 2025 (4)
20082026
AllStoriesComments NewestTopOldest
  1. imo fclones is the one to beat, https://github.com/pkolaczk/fclones#benchmarks nice that there are actually some ok interfaces here. with fclones, i tend to generate a file of candidates then do a little review to make super certain…
    comment by jauntywundrkind · 2026-07-26 · in DskDitto: Ultra-fast, parallel duplicate-file detector
  2. ▲ 2
    Fclones – Efficient Duplicate File Finder
    story by mihau · 2025-09-12 · 0 comments
  3. I've been using `fclones` [1] to do this, with `dedupe`, which uses reflink/clonefile. https://github.com/pkolaczk/fclones
    comment by zerd · 2025-02-25 · in Hyperspace
  4. …same command[1]: if cfg!(target_os = "macos") { result.push(format!("cp -c {target} {link}")); [1] https://github.com/pkolaczk/fclones/blob/555cde08fde4e700b25...
    comment by PenguinRevolver · 2025-02-25 · in Hyperspace
  5. https://github.com/pkolaczk/fclones can do the same thing, and it's perfectly free and open source. terminal based though
    comment by siranachronist · 2025-02-25 · in Hyperspace
  6. For duplicate files I've used the following: - https://github.com/adrianlopezroche/fdupes - https://github.com/pkolaczk/fclones The latter works well for larger datasets, outputs a TXT which you can analyse and decide what to do with.
    comment by wjdp · 2024-03-19 · in Ask HN: How should organize and back up 23 TiB of personal files?
  7. ▲ 12
    Fclones: Parallel duplicate files finder in Rust with reflink support
    story by anewhnaccount2 · 2024-02-07 · 0 comments
  8. ▲ 3
    Fclones: Efficient Duplicate File Finder
    story by anewhnaccount2 · 2024-02-05 · 0 comments
  9. I would suggest using https://github.com/pkolaczk/fclones instead. It's way faster.
    comment by frankjr · 2023-11-02 · in Fdupes: Identify or delete duplicate files
  10. …are not modified I think?). It looks like fclones implements this, is faster and is written in Rust https://github.com/pkolaczk/fclones (the last is the most important point of course /s).
    comment by anewhnaccount2 · 2023-01-26 · in Pip and cargo are not the same
  11. ▲ 62
    Fclones – an efficient duplicate file finder and remover
    story by feross · 2022-05-06 · 9 comments
  12. …but things like benchmarking tools, webservers or even duplicate file finders (shameless plug: https://github.com/pkolaczk/fclones#benchmarks - there is one Java app there, see its memory use :D)
    comment by pkolaczk · 2021-11-24 · in GC progress from JDK 8 to JDK 17
  13. See also fclones (focuses on performance, has benchmarks https://github.com/pkolaczk/fclones ). I didn't know about rdfind but thought the standard was fdupes https://github.com/adrianlopezroche/fdupes , which is as fast (or slow) as…
    comment by artemisart · 2021-08-30 · in Go Find Duplicates: A fast and simple tool to find duplicate files
  14. ▲ 5
    FClones – Fastest Duplicate File Finder
    story by sbt567 · 2021-04-05 · 1 comment
  15. ▲ 6
    Show HN: Fast duplicate/unique file finder in Rust
    story by pkolaczk · 2020-06-09 · 2 comments