moj-analytical-services/splink
View on GitHub ↗ ★ 2,553 Python
Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends
13 mentions on Hacker News by 3 people: 3 stories, 10 comments · first 2020-03-17 · latest 2026-03-03
20082026
-
Splink is a notable endeavor in this regard from the MoJ. https://github.com/moj-analytical-services/splink .
comment by Vohlenzer · 2026-03-03 · in I'm reluctant to verify my identity or age for any online services -
…finally getting to the stage where I'm really happy with both the performance and the API design. https://github.com/moj-analytical-services/splink
comment by RobinL · 2024-08-25 · in Ask HN: What are you working on (August 2024)? -
…also written up some interactive tutorials on how the method works [1] if anyone's interested [0] https://github.com/moj-analytical-services/splink [1] https://www.robinlinacre.com/intro_to_probabilistic_linkage/
comment by RobinL · 2024-07-04 · in Finding near-duplicates with Jaccard similarity and MinHash -
…Feel free to ask questions if you run into any issues - we're usually fairly good at responding: https://github.com/moj-analytical-services/splink/discussion...
comment by RobinL · 2023-08-14 · in Autospam and Naive Bayes -
…can be applied to big data. It's the engine behind Splink, the free Python library that I develop: https://github.com/moj-analytical-services/splink
comment by RobinL · 2023-08-14 · in Autospam and Naive Bayes -
…and is compatible with multiple database backends, and has a suite of interactive visualisations: https://github.com/moj-analytical-services/splink I believe it is the fastest and most accurate free solution
comment by RobinL · 2023-06-01 · in Ask HN: What projects are you working on? -
…and runs faster than most competitors because it's able to leverage the speed of these backends: https://github.com/moj-analytical-services/splink
comment by RobinL · 2023-02-11 · in DuckDB – An in-process SQL OLAP database management system -
…academia and the private sector, often replacing extremely expensive proprietary solutions. https://github.com/moj-analytical-services/splink More info in blog posts here: https://www.robinlinacre.com/introducing_splink/…
comment by RobinL · 2023-01-26 · in Ask HN: What have you created that deserves a second chance on HN? -
…translating between SQL engines, and we haven't hit any major problems, so kudos to the author! [1] https://github.com/moj-analytical-services/splink/tree/splin...
comment by RobinL · 2022-07-05 · in SQLGlot: SQL parser, transpiler, optimizer – translate to Presto, Spark, Hive -
…to say thanks to the DuckDB team for great work - you're enabling a lot of value downstream! [1] https://github.com/moj-analytical-services/splink [2] https://github.com/moj-analytical-services/splink_demos/tree...
comment by RobinL · 2022-03-07 · in Parallel Grouped Aggregation in DuckDB