awslabs/deequ
View on GitHub ↗ ★ 3,657 Scala
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
3 mentions on Hacker News by 3 people: 1 story, 2 comments · first 2021-05-10 · latest 2025-12-11
20082026
-
…similar to the aws deeque project but fancier and more inclusive of edge cases, common scenarios? ( https://github.com/awslabs/deequ )
comment by idomi · 2022-03-04 · in Launch HN: Elementary (YC W22) – Open-source data observability -
Deequ is the big data / Spark alternative for similar functionality in case anyone is interested: https://github.com/awslabs/deequ Looks like a great project and wanted to highlight why projects like these are much more useful for file…
comment by MrPowers · 2021-05-10 · in Show HN: DataProfiler – What's in your data? Extract schema, stats and entities