apache/arrow on Hacker News

…I thought a colleague of mine had filed an issue but I didn’t find it. I filed it myself just now: https://github.com/apache/arrow/issues/49310

comment by kccqzy · 2026-02-17 · in Apache Arrow is 10 years old

▲ 2

New Parquet writer allows easy insert/delete/edit

story by sps44 · 2025-05-19 · 0 comments

…: https://github.com/search?q=repo%3Aapache%2Farrow+async+lang... : test_flight_async.py https://github.com/apache/arrow/blob/main/python/pyarrow/tes... pyarrow/src/arrow/python/async.h: https://github.com/apache/arrow/blob/main/python/pyar…

comment by westurner · 2025-03-20 · in Show HN: Aiopandas – Async .apply() and .map() for Pandas, Faster API/LLMs Calls

…to enable passing statistics, and the DuckDB devs are working to implement this. Discussion at https://github.com/apache/arrow/issues/38837 .

comment by ianmcook · 2025-01-30 · in Adding concurrent read/write to DuckDB with Arrow Flight

https://github.com/apache/arrow/issues/34738 https://lists.apache.org/thread/lk277x3b9gjol42sjg27bst2ggm5...

comment by dumah · 2024-09-29 · in Show HN: Iceoryx2 – Fast IPC Library for Rust, C++, and C

…- after browsing how arrow is implemented for different languages (my experience is mainly C/C++) - https://github.com/apache/arrow/tree/main/go/arrow/math - there are bunch of .S ("asm" files) and I'm still not able to comprehend how…

comment by malkia · 2024-01-23 · in From slow to SIMD: A Go optimization story

…: > Apache Arrow already supports C, C++, Python, Rust, Go and has C GLib support Lua: https://github.com/apache/arrow/tree/main/c_glib/example/lua LearnXinYminutes Lua: https://learnxinyminutes.com/docs/lua/ OpenWRT is a Make-based Linux…

comment by westurner · 2023-11-04 · in Show HN: MicroLua – Lua for the RP2040 Microcontroller

…application. Apache Arrow already supports C, C++, Python, Rust, Go and has C GLib support Lua: https://github.com/apache/arrow/tree/main/c_glib/example/lua : > Arrow Lua example: All example codes use LGI to use Arrow GLib based bindings…

comment by westurner · 2023-11-01 · in Cave: A downloadable game engine for windows

The CSV parser for [Perspective]( https://github.com/finos/perspective ) uses the [Apache Arrow]( https://github.com/apache/arrow ) C++ CSV parser compiled to WASM. It's not currently multi-threaded but this is possible as well to my…

comment by texodus · 2023-09-07 · in Show HN: uDSV.js – A faster CSV parser

Worker should really adopt Apache Arrow, which has a much bigger ecosystem. https://github.com/apache/arrow

comment by vicaya · 2023-07-28 · in Cap'n Proto 1.0

…[1] https://arrow.apache.org/docs/python/generated/pyarrow.csv.R... [2] https://github.com/apache/arrow/blob/master/python/pyarrow/_...

comment by hfbff · 2023-02-11 · in Google Python Style Guide

…parallelism or partitioning). Hope that helps. [1]: https://arrow.apache.org/cookbook/ [2]: https://github.com/apache/arrow-cookbook/ [3]: https://github.com/apache/arrow/pull/12254

comment by lidavidm · 2022-02-16 · in Apache Arrow Flight SQL: Accelerating Database Access

…the sort of thing where you could just add a plugin to postgres and be arrowified or something? [1] https://github.com/apache/arrow/blob/release-7.0.0/java/flig...

comment by cogman10 · 2022-02-16 · in Apache Arrow Flight SQL: Accelerating Database Access

…[1] https://stackoverflow.com/a/67911190/881025 [2] https://github.com/apache/parquet-cpp [3] https://github.com/apache/arrow/tree/master/cpp

comment by kristjansson · 2021-10-27 · in Comparing SQLite, DuckDB and Arrow with UN trade data

…validate method implemented). Case study - Apache Arrow uses flatbuffers to persist its metadata: https://github.com/apache/arrow/tree/master/format

comment by liuliu · 2021-07-23 · in Zip – How not to design a file format

…in a break from the mono-repo model. Read more at the announcement[3] or the merge request[4]. [0] https://github.com/apache/arrow-datafusion [1] https://github.com/apache/arrow-rs [2] https://arrow.apache.org/blog/2021/05/04/rust-dev-workf…

comment by michael_j_ward · 2021-05-05 · in Apache Arrow 4.0

Great to see Ballista in arrow https://github.com/apache/arrow/pull/9723

comment by phissenschaft · 2021-05-05 · in Apache Arrow 4.0

▲ 2

Ballista, distributed compute in Rust, merged into Apache Arrow

story by wdavidw · 2021-03-26 · 0 comments

https://github.com/apache/arrow/tree/master/format

comment by poorman · 2021-02-03 · in Apache Arrow 3.0

…bit lacking at the moment). [1] https://arrow.apache.org/docs/cpp/api/tensor.html?highlight=... [2] https://github.com/apache/arrow/blob/master/python/pyarrow/t...

comment by mihevc · 2021-01-01 · in Sparse Matrices (2019)

…rather active Apache Arrow project. https://stackoverflow.com/questions/53533506/what-is-the-dif... https://github.com/apache/arrow/commit/e6905effbb9383afd2423... And the platform/tools side of Drill now lives on as Dremio, which uses…

comment by vhold · 2020-05-20 · in Apache Drill's Future

It's using the Rust native arrow library, from the DataFusion project. So nope, pure rust. https://github.com/apache/arrow/tree/master/rust/arrow

comment by jamwt · 2020-04-06 · in Rust Dataframe: Update 1

https://github.com/apache/arrow/tree/master/format Are your in-memory formatted structures. Even better, there are libraries in many languages for accessing them. As such you can consider the data almost as an ffi between languages.…

comment by alexisread · 2020-02-19 · in Programmer's critique of missing structure of operating systems

…ownership of the memory returned by gRPC to obtain zero copy. The C++ details are found in https://github.com/apache/arrow/blob/master/cpp/src/arrow/fl...

comment by wesm · 2019-10-15 · in Apache Arrow Flight: A Framework for Fast Data Transport

How about Dask - which is fairly production grade and has experimental Arrow integration. https://github.com/apache/arrow/blob/master/integration/dask... Dask deploys pretty well on k8s - https://kubernetes.dask.org/en/latest/

comment by sandGorgon · 2019-07-17 · in Ballista: Distributed Compute with Rust, Apache Arrow, and Kubernetes

…regularly, with types—and library support for multiple languages. Never used it, myself, though. https://github.com/apache/arrow

comment by 52-6F-62 · 2019-02-04 · in TensorFlow.js: Machine Learning for the Web and Beyond

…of JS versions of Arrow for, I believe, showing a bunch more in the browser than you normally see: https://github.com/apache/arrow/tree/master/js . The Graphistry team has collaborating on the Apache side as part of how we pull off…

comment by lmeyerov · 2018-06-25 · in What is GeoMesa?

…the full & accelerated pydata world to JavaScript. We started with Arrow columnar data bindings ( https://github.com/apache/arrow/tree/master/js ). Next stop is Plasma bindings in node for zero-copy node<>pydata interop. That enables…

comment by lmeyerov · 2018-03-03 · in Pandas on Ray – Make Pandas faster

…For comparison, dplyr and arrow: https://github.com/tidyverse/dplyr/tree/master/src https://github.com/apache/arrow/tree/master/cpp/src/arrow C++ does seem to be useful for stuff like this.

comment by chubot · 2017-10-31 · in Do we need a third Apache project for columnar data representation?

…opening to others, but we've been investing big on Arrow for our V2. Ex: We recently released https://github.com/apache/arrow/tree/master/js and are generally using Arrow as a way to compose interactive-time columnar CPU/GPU visual…

comment by lmeyerov · 2017-09-26 · in Apache Arrow and the “Things I Hate About Pandas”

I usually watch the Apache projects. Apache Arrow ( https://github.com/apache/arrow/ ) is very interesting and promising project. It is in early state; you can watch the design decisions taken and how they are implemented. Plus it is…

comment by morazow · 2016-08-28 · in GitHub Code Search – Programmers' Goldmine

Where are the API docs? this seem rather useless: https://github.com/apache/arrow

comment by okigan · 2016-02-18 · in Apache Arrow: A new open source in-memory columnar data format

…was live when the press announcements went out. The Github mirror is now live, you can see it here: https://github.com/apache/arrow

comment by jaltekruse · 2016-02-17 · in Apache Arrow: A new open source in-memory columnar data format