Hacker GitHub

← All repos

sahib/rmlint

View on GitHub ↗ ★ 2,449 C

Extremely fast tool to remove duplicates and other lint from your filesystem

14 mentions on Hacker News by 14 people: 1 story, 13 comments · first 2017-05-22 · latest 2026-04-12

Mentions per year 14 mentions · busiest year 2023 (3)
20082026
AllStoriesComments NewestTopOldest
  1. > https://github.com/sahib/rmlint is the one I had in mind. Ah, right, thanks. I now dimly recall some old project realizing fs-snapshots using hard links, which one could consider some sort of deduplication as well. > I think you are…
    comment by guenthert · 2026-04-12 · in Simplest Hash Functions
  2. https://github.com/sahib/rmlint is the one I had in mind. > Those use a rather expensive hash function (you really want to avoid hash collisions), [...] Then we are clearly not thinking of the same kind of software. > but (at least some…
    comment by eru · 2026-04-12 · in Simplest Hash Functions
  3. See the comments on https://news.ycombinator.com/item?id=38113396 for a list of alternatives. I used https://github.com/sahib/rmlint in the past and can't complain.
    comment by Recursing · 2025-02-26 · in Hyperspace
  4. It does not support APFS: https://github.com/sahib/rmlint/issues/421
    comment by dewey · 2025-02-25 · in Hyperspace
  5. …works out of the box, but you can write your own alternative script that just links both files [1]: https://github.com/sahib/rmlint
    comment by augusto-moura · 2025-02-25 · in Hyperspace
  6. …of space this way. Or just use a filesystem that supports deduplication natively like btrfs/zfs. https://github.com/sahib/rmlint
    comment by lye · 2024-06-12 · in Python wheel filenames have no canonical form
  7. My preferred solution is rmlint [ https://github.com/sahib/rmlint ] mostly because it also looks at duplicate directories. It produces a bash script instead of deleting anything itself, so you can examine it before running the script it…
    comment by tryptophan · 2023-11-05 · in Fdupes: Identify or delete duplicate files
  8. …wanted way more RAM and felt slower than my other pool. After I removed duplicates (with help of https://github.com/sahib/rmlint ), I migrated my photos to an ordinary zpool instead.
    comment by tonoto · 2023-07-05 · in ZFS 2.2.0 (RC): Block Cloning merged
  9. …I've tried many, but rmlint is the most flexible and reliable. Esp. the tagging works really well. https://github.com/sahib/rmlint
    comment by jbverschoor · 2023-06-13 · in Johnny Decimal
  10. …https://github.com/pauldreik/rdfind https://github.com/jvirkki/dupd https://github.com/sahib/rmlint Had not encountered fclones before, will give it a try.
    comment by jjav · 2021-08-31 · in Go Find Duplicates: A fast and simple tool to find duplicate files
  11. I've found rmlint to be another very good tool in this space: https://github.com/sahib/rmlint
    comment by code_biologist · 2021-08-30 · in Go Find Duplicates: A fast and simple tool to find duplicate files
  12. rmlint[1] works extremely well for duplicated files (including photos) [1] https://github.com/sahib/rmlint
    comment by yellow_lead · 2020-08-01 · in Ask HN: How do you organise and de-duplicate photos from old storage?
  13. ▲ 2
    Rmlint: Extremely fast tool to remove duplicates from your filesystem
    story by rajesh-s · 2020-01-08 · 0 comments
  14. …video editing software helpfully duplicated huge videos on import. https://rdfind.pauldreik.se/ https://github.com/sahib/rmlint There are great GUI visualizers for disk space, like WizTree/Baobab; for the command line I've had success with…
    comment by j_s · 2017-05-22 · in Linux utils that you might not know