delta-io/delta-rs
View on GitHub ↗ ★ 3,352 Rust
A native Rust library for Delta Lake, with bindings into Python
9 mentions on Hacker News by 8 people: 3 stories, 6 comments · first 2021-01-19 · latest 2025-11-13
20082026
-
…relies on delta-rs for Delta Lake support, and that is what does not support Deletion vectors: https://github.com/delta-io/delta-rs/issues/1094 It seems like these single-node libraries can process a terabyte on a typical machine, and…
comment by esafak · 2025-11-13 · in 650GB of Data (Delta Lake on S3). Polars vs. DuckDB vs. Daft vs. Spark -
You can already have it in Delta with Delta Rust and Python bindings: https://github.com/delta-io/delta-rs
comment by alexott · 2024-06-20 · in Lessons Learned from Scaling to Multi-Terabyte Datasets -
▲ 3
Delta-rs – a Rust-based implementation of deltalakestory by martymmm · 2024-04-08 · 0 comments
-
I work at Databricks, but am pretty much just an OSS nerd, mainly focusing on Delta Rust recently: https://github.com/delta-io/delta-rs I did some keyword research and wrote this post cause lots of folks are doing searches for Delta Lake…
comment by MrPowers · 2024-01-19 · in Delta Lake vs. Parquet: A Comparison -
PyO3 is being used to expose the Python bindings to the delta-rs project: https://github.com/delta-io/delta-rs It's a great way to expose Python bindings because it "feels" Pythonic. Most users run pip install deltalake and are completely…
comment by MrPowers · 2023-02-28 · in How to write Python extensions in Rust with PyO3 -
▲ 8
Show HN: A formally verified native Delta Lake implementation in Ruststory by houqp · 2022-09-28 · 0 comments
-
▲ 3
Delta-RS: Low level access to Delta tables in Ruststory by moritzmeister · 2021-07-22 · 0 comments
-
…Would love to read a delta lake table into a native python object without the need for spark. [1] https://github.com/delta-io/delta-rs
comment by Braxton_Hicks · 2021-02-01 · in Databricks is an RDBMS -
This looks to be the integration test: https://github.com/delta-io/delta-rs/commit/09d345e52ca3177d... I'm not sure why the author thinks this required putting the credentials in the code itself. Heck, I'd argue that this integration test…
comment by aECBNhWl4sqXr2 · 2021-01-19 · in Intentionally Leaking AWS Keys