Hacker GitHub

← All repos

pola-rs/polars

View on GitHub ↗ ★ 40,248 Rust

Extremely fast Query Engine for DataFrames, written in Rust

50 mentions on Hacker News by 39 people: 10 stories, 40 comments · first 2021-09-14 · latest 2026-10-06

Mentions per year 50 mentions · busiest year 2024 (14)
20082026
AllStoriesComments NewestTopOldest
  1. …an asof join so I guess the mapping hasn't been made yet from SQL. Could you open up an issue at https://github.com/pola-rs/polars/issues ?
    comment by orlp · 2026-10-06 · in Polars 2.0
  2. It does not use datafusion. https://github.com/pola-rs/polars/issues/6197
    comment by esafak · 2026-10-06 · in Polars 2.0
  3. …to python and successfully solved the interface boundayr problems described in the article. [0] https://github.com/pola-rs/polars
    comment by lr1970 · 2026-09-14 · in Libraries Run Rust Inside Python (With PyO3)
  4. Here are a few examples you might find credible: - pola-rs/polars: https://github.com/pola-rs/polars/pull/26823 - ~2.68x median speedup of primitive-to-boolean casting credited to Claude Opus 4.6 - pydantic/monty:…
    comment by simonw · 2026-08-09 · in Is it all just vapourware?
  5. …SIMD-optimized libraries for this? Polars Rust is built on Arrow and packed_simd. pola-rs/polars: https://github.com/pola-rs/polars polars - Rust API docs: https://docs.pola.rs/api/rust/dev/polars/#simd lancedb's data format; Lancedb/lance…
    comment by westurner · 2026-07-30 · in Pgrust v0.2: Now faster than Postgres and Clickhouse Latest
  6. …"b"] += 1 Perhaps nobody has requested slice syntax? It seems like it would be easy to add. [1]: https://github.com/pola-rs/polars/blob/9079e20ae59f8c75dcce8...
    comment by richardbachman · 2026-01-29 · in Pandas 3.0
  7. …[1]. Even the popular polars dataframe library [2] uses it. [1] https://github.com/PyO3/pyo3 [2] https://github.com/pola-rs/polars
    comment by goku12 · 2026-01-06 · in C Is Best (2025)
  8. …to do this if there's interest...polars wasn't an option because we needed Arrow extension types ( https://github.com/pola-rs/polars/issues/9112 ).
    comment by paleolimbot · 2025-09-25 · in SedonaDB: A new geospatial DataFrame library written in Rust
  9. …creating this issue, it is worth investigating! I see you also created similar issues in Polars: https://github.com/pola-rs/polars/issues/17932 and DuckDB: https://github.com/duckdb/duckdb/issues/17066 ClickHouse has a built-in memory…
    comment by AlexClickHouse · 2025-05-30 · in ClickHouse raises $350M Series C
  10. This is false. The polars api has used smart string for a long time. https://github.com/pola-rs/polars/blob/32a2325b55f9bce81d019...
    comment by jtrueb · 2024-08-07 · in Why Polars rewrote its Arrow string data type
  11. …[2] where most comments are prior to the announcement. [1] https://pola.rs/posts/polars-on-gpu/ [2] https://github.com/pola-rs/polars/issues/13111
    comment by simicd · 2024-07-01 · in Announcing Polars 1.0 (Blog Post)
  12. Would probably try https://github.com/pola-rs/polars and go from there lol
    comment by TeamDman · 2024-05-27 · in Big data is dead (2023)
  13. …Python's correctly-rounded division is rather expensive, I chose to stick to this (more context: https://github.com/pola-rs/polars/issues/14596#issuecomment-... ).
    comment by orlp · 2024-02-28 · in Why Python's integer division floors (2010)
  14. …example but gets a bit closer compared to the pandas approach. - https://pypi.org/project/polars/ - https://github.com/pola-rs/polars/
    comment by cmdlineluser · 2024-02-22 · in Why Pandas feels clunky when coming from R
  15. 1.0 should be soon. https://github.com/pola-rs/polars/issues/6616
    comment by n8henrie · 2024-01-09 · in Polars
  16. …known as "polars-book" before it has been was in-tree [1]. [0] https://docs.pola.rs/user-guide/ [1] https://github.com/pola-rs/polars/tree/main/docs/user-guide
    comment by lr1970 · 2024-01-09 · in Polars
  17. …the GitHub page, which explains what the library is about to people with data analysis backgrounds: https://github.com/pola-rs/polars
    comment by pama · 2024-01-09 · in Polars
  18. Spark feels overwrought, but polars does not scale out yet. https://github.com/pola-rs/polars/issues/5621
    comment by esafak · 2024-01-09 · in Polars
  19. …of an OLAP Query Engine implemented in Rust using Apache Arrow Columnar Format as the memory model. https://github.com/pola-rs/polars/blob/main/README.md
    comment by adolph · 2024-01-09 · in Polars
  20. You made me curious to look up the recent breaking releases https://github.com/pola-rs/polars/releases/tag/py-0.19.0 https://github.com/pola-rs/polars/releases/tag/py-0.20.0 And their policy about it: https://docs.pola.rs/development/versio…
    comment by asqueella · 2024-01-09 · in Polars
  21. …my main complaint, that categories cannot be pre-defined, seems to have been recently addressed: https://github.com/pola-rs/polars/issues/10705 - polars is not yet 1.0, breaking changes will happen
    comment by radus · 2024-01-09 · in Polars
  22. Wow that was fast! https://github.com/pola-rs/polars/pull/12517
    comment by simonw · 2023-11-17 · in Summing columns in remote Parquet files using DuckDB
  23. Looks like somebody requested it after reading your TIL. https://github.com/pola-rs/polars/issues/12493#issuecomment-... It will be in the next release. (later today?)
    comment by cmdlineluser · 2023-11-17 · in Summing columns in remote Parquet files using DuckDB
  24. Once this is fixed: https://github.com/pola-rs/polars/pull/7084
    comment by ec109685 · 2023-02-28 · in Pandas 2.0 and the Arrow revolution
  25. …need spreadsheet type immediacy it's worth looking into Mito. Rustaceans should look into pola.rs: https://github.com/pola-rs/polars
    comment by anigbrowl · 2023-02-26 · in A Relational Spreadsheet
  26. …for larger than ram. Polars is completely built on arrow, so the same advantages should apply. https://github.com/pola-rs/polars#handles-larger-than-ram-da...
    comment by riezebos · 2023-02-11 · in DuckDB – An in-process SQL OLAP database management system
  27. No; there is an OOC (out-of-core, eg: > RAM) streaming mode. https://github.com/pola-rs/polars#handles-larger-than-ram-da...
    comment by ayembee · 2023-01-22 · in Replacing Pandas with Polars
  28. …running into issues with the Lazy API, read through these tests and see if that clears anything up: https://github.com/pola-rs/polars/tree/master/polars/polars-... My usage is very narrow (aggregating a dataframe of bounding box…
    comment by grepLeigh · 2023-01-15 · in You can run Rust code in a Jupyter notebook
  29. Yes, we have basic support. Here are some examples of how to use it in python: https://github.com/pola-rs/polars/blob/91a419acaf024e64410e7... However, full sql support is on the roadmap. It's just a matter of hours in a day...
    comment by ritchie46 · 2022-12-31 · in I wrote a SQL engine in Python
  30. …Of course nowhere near Python but that is hard to beat today. [1] https://github.com/PyO3/pyo3 [2] https://github.com/pola-rs/polars/ [3] https://github.com/dimforge/nalgebra [4] https://github.com/apache/arrow-datafusion [5]…
    comment by Gwypaas · 2022-12-22 · in Welcome to Comprehensive Rust
  31. …space: https://github.com/MaterializeInc/materialize https://github.com/apache/arrow-datafusion https://github.com/pola-rs/polars
    comment by KptMarchewa · 2022-08-12 · in Ask HN: Who is using C++ as the main language for new project?
  32. …when comparing to pandas) and consistent API across Rust, Python, JS. [0] https://www.pola.rs/ [1] https://github.com/pola-rs/polars [2] https://h2oai.github.io/db-benchmark/ [3] https://www.pola.rs/benchmarks.html
    comment by lr1970 · 2022-07-07 · in I analyzed hospital price lists so you didn't have to
  33. It's been done: https://github.com/pola-rs/polars But I'm sure there's always room for improvement
    comment by SnooSux · 2022-05-05 · in Modern Python Performance Considerations
  34. …a 500 line Python script being refactored with Rust and make me think of the Polars project: https://github.com/pola-rs/polars Polars uses Rust to make DataFrame operations lightning fast. But you don't need to use Rust to use Polars. Just…
    comment by MrPowers · 2022-05-04 · in Ask HN: Have we screwed ourselves as software engineers?
  35. I'd recommend checking out polars as an alternative to pandas - https://github.com/pola-rs/polars It has a rather different api, and is significantly faster. Highly recommend it.
    comment by tomtom1337 · 2022-05-01 · in Modern Pandas (Part 2): Method Chaining
  36. It says here: https://github.com/pola-rs/polars/issues/580#issuecomment-82... , that Polars has zero copy for arrow and numpy.
    comment by elforce002 · 2022-01-17 · in What would it take to recreate dplyr in Python? (2020)
  37. Polars is not using Rust bindings for Arrow, it uses a Rust implementation called arrow2: https://github.com/pola-rs/polars/blob/master/polars/polars-... Arrow2: https://lib.rs/crates/arrow2
    comment by bogeholm · 2021-12-17 · in Polars: Fast DataFrame library for Rust and Python
  38. …for looking! -- [1] https://github.com/elixir-nx/nx [2] https://github.com/elixir-nx/axon [3] https://github.com/pola-rs/polars [4] https://github.com/rusterlium/rustler [5] https://dplyr.tidyverse.org/
    comment by cigrainger · 2021-11-05 · in Show HN: Dataframes in Elixir Backed by Rust
  39. …I've never used Vaex, but I've used datatable ( https://github.com/h2oai/datatable ) and polars ( https://github.com/pola-rs/polars ). Polars is my favorite API, but datatable was faster at reading data (Polars was faster in execution).…
    comment by mrtranscendence · 2021-09-14 · in Scikit-Learn Version 1.0
  40. …include the index ... Handles time series really well, though. Recently I've been using polars ( https://github.com/pola-rs/polars ). As an API I much, much prefer it to pandas, and it's a lot faster. Comes at the cost of not using numpy…
    comment by mrtranscendence · 2021-09-14 · in Scikit-Learn Version 1.0