MrPowers/chispa
View on GitHub ↗ ★ 778 Python
PySpark test helper methods with beautiful error messages
3 mentions on Hacker News by 1 person: 0 stories, 3 comments · first 2020-10-21 · latest 2021-05-16
20082026
-
…) to provide a good testing workflow. quinn ( https://github.com/MrPowers/quinn ) and chispa ( https://github.com/MrPowers/chispa ) are the PySpark equivalents. Built bebe ( https://github.com/MrPowers/bebe ) to expose the Spark Catalyst…
comment by MrPowers · 2021-05-16 · in Ask HN: What are some tools / libraries you built yourself? -
…Wheel files. Speaking of testing, can you let me know if this PySpark testing fix worked for you ;) https://github.com/MrPowers/chispa/issues/6
comment by MrPowers · 2021-02-14 · in Why Databricks Is Winning -
…The chispa README also provides a lot of useful info on how to properly write PySpark code: https://github.com/MrPowers/chispa Scala is easier than Python for Spark because it allows functions with multiple argument lists and isn't…
comment by MrPowers · 2020-10-21 · in PySpark Style Guide