apache/datafusion-comet
View on GitHub ↗ ★ 1,320 Scala
Apache DataFusion Comet Spark Accelerator
4 mentions on Hacker News by 4 people: 1 story, 3 comments · first 2024-05-31 · latest 2025-03-07
20082026
-
…bigger companies to switch, and whether they'll try a Spark compatibility layer like DataFusion ( https://github.com/apache/datafusion-comet ).
comment by tfehring · 2025-03-07 · in Polars Cloud: The Distributed Cloud Architecture to Run Polars Anywhere -
…https://github.com/apache/datafusion/pulls?q=is%3Apr+author%... Datafusion comet contributions: https://github.com/apache/datafusion-comet/pulls?q=is%3Apr+a... Let’s connect!
comment by jatin510 · 2025-02-04 · in Ask HN: Who wants to be hired? (February 2025) -
I wonder if similar performance can be achieved with Spark accelerator like https://github.com/apache/datafusion-comet . Of course it didn’t exist 4 years ago, but would it cheaper to build?
comment by whoevercares · 2024-07-31 · in Amazon's exabyte-scale migration from Apache Spark to Ray on EC2 -
▲ 107
DataFusion Comet: Apache Spark Acceleratorstory by andygrove · 2024-05-31 · 25 comments