MinishLab/semhash
View on GitHub ↗ ★ 979 Python
Fast Multimodal Semantic Deduplication & Filtering
5 mentions on Hacker News by 4 people: 3 stories, 2 comments · first 2025-01-12 · latest 2026-07-03
20082026
-
Have you compared this to https://github.com/MinishLab/semhash (or considered using that for the deduplication backend)?
comment by Bibabomas · 2026-07-03 · in Show HN: CLI tool for detecting non-exact code duplication with embedding models -
…worked on something similar in the past that works for larger datasets (semantic deduplication: https://github.com/MinishLab/semhash ).
comment by Tananon · 2025-10-19 · in Show HN: Pyversity – Fast Result Diversification for Retrieval and RAG -
▲ 7
Show HN: SemHash – Semantic Text Deduplication, Outlier Filtering and Samplingstory by Tananon · 2025-04-27 · 0 comments
-
▲ 6
Show HN: SemHash – Fast Semantic Text Deduplication for Cleaner Datasetsstory by stephantul · 2025-01-19 · 0 comments
-
▲ 19
Show HN: SemHash – Fast Semantic Text Deduplication for Cleaner Datasetsstory by Pringled · 2025-01-12 · 6 comments