Hacker GitHub

← All repos

Eventual-Inc/Daft

View on GitHub ↗ ★ 5,821 Rust

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

11 mentions on Hacker News by 7 people: 1 story, 10 comments · first 2023-06-06 · latest 2025-11-14

Mentions per year 11 mentions · busiest year 2024 (7)
20082026
AllStoriesComments NewestTopOldest
  1. …couple of releases. If you're interested to learn more about our findings, check out our GitHub ( https://github.com/Eventual-Inc/Daft ) or follow us on Twitter ( https://x.com/daftengine ) and LinkedIn (…
    comment by srilman · 2025-11-14 · in 650GB of Data (Delta Lake on S3). Polars vs. DuckDB vs. Daft vs. Spark
  2. How about daft https://github.com/Eventual-Inc/Daft - also looks like a new multimodal dataframe framework
    comment by m0sth8 · 2024-11-05 · in DataChain: DBT for Unstructured Data
  3. https://github.com/Eventual-Inc/Daft Is also great at these types of workloads since it’s both distributed and vectorized!
    comment by sammysidhu · 2024-06-20 · in Lessons Learned from Scaling to Multi-Terabyte Datasets
  4. …integration into various catalogs through a thin layer that exposes ScanTasks. Iceberg's impl: https://github.com/Eventual-Inc/Daft/blob/416009138359a9d410...
    comment by sammysidhu · 2024-05-14 · in Pg_lakehouse: Query Any Data Lake from Postgres
  5. …implementation of Hudi was contributed by the Hudi team and currently still lives in our repo :D ( https://github.com/Eventual-Inc/Daft/tree/main/daft/hudi/pyh... ) It’s still the case that these libraries still lag behind their JVM…
    comment by jaychia · 2024-05-14 · in Pg_lakehouse: Query Any Data Lake from Postgres
  6. …well as flesh out our documentation for partitioning. Edit: added a new issue for regex support :) https://github.com/Eventual-Inc/Daft/issues/1962
    comment by jaychia · 2024-03-01 · in Daft: Distributed DataFrame for Python
  7. There are benchmarks here - https://github.com/Eventual-Inc/Daft?tab=readme-ov-file#benc... . Seems to outperform Dask by a fair bit.
    comment by hiyer · 2024-03-01 · in Daft: Distributed DataFrame for Python
  8. ▲ 129
    Daft: Distributed DataFrame for Python
    story by tosh · 2024-02-29 · 39 comments
  9. …the Daft maintainers here) Great call out! I went ahead and make an issue for us to work on this: https://github.com/Eventual-Inc/Daft/issues/1016
    comment by sammysidhu · 2023-06-07 · in Daft: A High-Performance Distributed Dataframe Library for Multimodal Data
  10. …I went ahead and made an issue to add `export DO_NOT_TRACK=1` as one of the variables we track! https://github.com/Eventual-Inc/Daft/issues/1015
    comment by sammysidhu · 2023-06-07 · in Daft: A High-Performance Distributed Dataframe Library for Multimodal Data
  11. GitHub git: https://github.com/Eventual-Inc/Daft
    comment by rektide · 2023-06-06 · in Daft: A High-Performance Distributed Dataframe Library for Multimodal Data