Hacker GitHub

← All repos

apache/datafusion-comet

View on GitHub ↗ ★ 1,320 Scala

Apache DataFusion Comet Spark Accelerator

4 mentions on Hacker News by 4 people: 1 story, 3 comments · first 2024-05-31 · latest 2025-03-07

Mentions per year 4 mentions · busiest year 2024 (2)
20082026
AllStoriesComments NewestTopOldest
  1. …bigger companies to switch, and whether they'll try a Spark compatibility layer like DataFusion ( https://github.com/apache/datafusion-comet ).
    comment by tfehring · 2025-03-07 · in Polars Cloud: The Distributed Cloud Architecture to Run Polars Anywhere
  2. …https://github.com/apache/datafusion/pulls?q=is%3Apr+author%... Datafusion comet contributions: https://github.com/apache/datafusion-comet/pulls?q=is%3Apr+a... Let’s connect!
    comment by jatin510 · 2025-02-04 · in Ask HN: Who wants to be hired? (February 2025)
  3. I wonder if similar performance can be achieved with Spark accelerator like https://github.com/apache/datafusion-comet . Of course it didn’t exist 4 years ago, but would it cheaper to build?
    comment by whoevercares · 2024-07-31 · in Amazon's exabyte-scale migration from Apache Spark to Ray on EC2