Hacker GitHub

← All repos

ttkb-oss/dedup

View on GitHub ↗ ★ 243 C

dedup finds and clones duplicate files

8 mentions on Hacker News by 3 people: 1 story, 7 comments · first 2023-11-13 · latest 2025-02-26

Mentions per year 8 mentions · busiest year 2025 (4)
20082026
  1. …I have attempted to improve the installation step slightly and have created this pull request: https://github.com/ttkb-oss/dedup/pull/6
    comment by gurjeet · 2025-02-26 · in Hyperspace
  2. …I would add a test for SHA-256 collisions, but no one has seemed to find a working example yet. 0 - https://github.com/ttkb-oss/dedup
    comment by jonhohle · 2025-02-26 · in Hyperspace
  3. If you don’t mind CLI tools, You can try dedup - https://github.com/ttkb-oss/dedup . Use the —-dry-run option to get a list of files that would be merged without modifying anything and how much space would be saved.
    comment by jonhohle · 2025-02-26 · in Hyperspace
  4. …It hasn’t destroyed any of my own data, but like any file system tool, use at your own risk. 0 - https://github.com/ttkb-oss/dedup
    comment by jonhohle · 2025-02-25 · in Hyperspace
  5. …the FTSENT already provided everything I needed. 0 - https://linux.die.net/man/3/fts_read 1 - https://github.com/ttkb-oss/dedup/blob/6a906db5a940df71deb4f...
  6. ▲ 2
    dedup: dedup finds and clones duplicate files in APFS
    story by tambourine_man · 2024-03-28 · 2 comments
  7. …and there are things that work similarly already (encryption, and clone ids, for example). 0 - https://github.com/ttkb-oss/dedup
    comment by jonhohle · 2024-03-27 · in Happy birthday APFS, 7 years old today
  8. …Hashing is the bottleneck for `dedup`, so finding a faster hasher would have a lot of benefits. 0 - https://github.com/ttkb-oss/dedup
    comment by jonhohle · 2023-11-13 · in Reasons to Prefer Blake3 over Sha256