Hacker GitHub

← All repos

sfu-db/connector-x

View on GitHub ↗ ★ 2,661 Rust

Fastest library to load data from DB to DataFrames in Rust and Python

5 mentions on Hacker News by 5 people: 3 stories, 2 comments · first 2021-07-30 · latest 2025-03-17

Mentions per year 5 mentions · busiest year 2021 (2)
20082026
  1. ▲ 2
    ConnectorX: Accelerating Data Loading From Databases to Dataframes
    story by qianli_cs · 2025-03-17 · 0 comments
  2. I was trying https://github.com/sfu-db/connector-x and hacking around with this https://github.com/spitz-dan-l/postgres-binary-parser but it turned out that a COPY to csv using asyncpg and then converting to parquet was the fastest.
  3. Another tip: use https://github.com/sfu-db/connector-x to load database query result to pandas without memory copy resulting in faster operation.
  4. ▲ 2
    Fastest library to load data from DB to DataFrames
    story by riyadparvez · 2021-10-15 · 1 comment
  5. ▲ 14
    ConnectorX: The fastest tool to load data from databases to dataframes
    story by xiaoying_wang · 2021-07-30 · 1 comment