Hacker GitHub

← All repos

vaexio/vaex

View on GitHub ↗ ★ 8,518 Python

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀

10 mentions on Hacker News by 6 people: 2 stories, 8 comments · first 2018-12-14 · latest 2021-12-17

Mentions per year 10 mentions · busiest year 2018 (4)
20082026
AllStoriesComments NewestTopOldest
  1. I believe Vaex can do this, in addition to GPU processing and reading direct from s3. https://github.com/vaexio/vaex
    comment by alexisread · 2021-12-17 · in Polars: Fast DataFrame library for Rust and Python
  2. …a try. it's along those lines – out-of-core data frame library, but also works on a single machine https://github.com/vaexio/vaex
    comment by nighthawk454 · 2021-03-14 · in I wrote one of the fastest DataFrame libraries
  3. My guess is that should be possible, feel free to hop onto https://github.com/vaexio/vaex/discussions !
    comment by maartenbreddels · 2021-03-09 · in A Hybrid Apache Arrow/Numpy DataFrame with Vaex Version 4.0
  4. ▲ 4
    Vaex (Python) = billion rows per second
    story by davidfoster · 2019-12-11 · 0 comments
  5. …can take shortcuts here. If you want to do a serious benchmark, feel free to contact us. Github: https://github.com/vaexio/vaex/issues Email: (I'm easy to google).
    comment by maartenbreddels · 2019-12-02 · in Show HN: How to analyse 100 GB of data on your laptop with Python
  6. ▲ 1
    Vaex: Out-of-Core DataFrames for Python, visualize and explore big tabular data
    story by gkst · 2019-09-05 · 0 comments
  7. There is an issue open for this: https://github.com/vaexio/vaex/issues/93 It should have been fixed, some more detailed report (version numbers installed) would be good to know.
    comment by maartenbreddels · 2018-12-14 · in Show HN: Vaex - Out of Core Dataframes for Python and Fast Visualization
  8. …own memory model. If you input Arrow, it converts to the Vaex data representation. Details here: https://github.com/vaexio/vaex/blob/master/packages/vaex-arr... One of the primary objectives of Apache Arrow is to have a common data…
    comment by wesm · 2018-12-14 · in Show HN: Vaex - Out of Core Dataframes for Python and Fast Visualization
  9. …does btw) My question is to you is, would you be so kind to open an issue to decribe the failure on https://github.com/vaexio/vaex/issues ? Please share which OS, which Python distribution (anaconda maybe) and/or the installation steps and…
    comment by maartenbreddels · 2018-12-14 · in Show HN: Vaex - Out of Core Dataframes for Python and Fast Visualization
  10. …there is overlap). If you think vaex can be useful here, feel free to ask question/open issues https://github.com/vaexio/vaex
    comment by maartenbreddels · 2018-12-14 · in Show HN: Vaex - Out of Core Dataframes for Python and Fast Visualization