vortex-data/vortex
View on GitHub ↗ ★ 3,297 Rust
An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.
19 mentions on Hacker News by 18 people: 6 stories, 13 comments · first 2024-05-02 · latest 2026-07-30
20082026
-
…Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation. https://github.com/vortex-data/vortex Vortex also has Segment Profiling and Adaptive Encoding. "What is Vortex? Columnar File Format…
comment by westurner · 2026-07-30 · in Pgrust v0.2: Now faster than Postgres and Clickhouse Latest -
▲ 4
Show HN: Spice 2.0 – Real-Time Analytical Query on Operational Data, Without ETLstory by lukekim · 2026-07-09 · 0 comments
-
…follow on post where we show how we used this to optimize an FSST decompression kernel for vortex ( https://github.com/vortex-data/vortex ).
comment by gnurizen · 2026-06-15 · in Show HN: Continuous Nvidia CUDA PC Sampling Profiler -
▲ 42
Show HN: Spice Cayenne – SQL acceleration built on Vortexstory by lukekim · 2025-12-18 · 4 comments
-
They seem to have removed the emojis since I posted my comment: https://github.com/vortex-data/vortex/commit/8294dd665869a72...
comment by xigoi · 2025-11-21 · in Vortex: An extensible, state of the art columnar file format -
…time on GPUs, so a fast path straight from these Vortex files to GPU memory seems promising. [1] https://github.com/vortex-data/vortex/issues/2116
comment by kipukun · 2025-11-20 · in Vortex: An extensible, state of the art columnar file format -
▲ 115
Vortex: An extensible, state of the art columnar file formatstory by tanelpoder · 2025-11-15 · 30 comments
-
▲ 6
Vortex – An extensible, state of the art columnar file formatstory by rickette · 2025-11-12 · 1 comment
-
▲ 2
Vortex: An extensible, state of the art columnar file formatstory by 0x1997 · 2025-09-03 · 0 comments
-
Any comparison with https://github.com/vortex-data/vortex ? Also any plans to integrate with polars?
comment by jmakov · 2025-07-24 · in The FastLanes File Format [pdf] -
Off the top of my head: - Vortex https://github.com/vortex-data/vortex - Lance https://github.com/lancedb/lance - Nimble https://github.com/facebookincubator/nimble There are also a bunch of ideas coming out of academia, but I don't know…
comment by MasterIdiot · 2025-07-15 · in Embedding user-defined indexes in Apache Parquet -
We have a TableProvider for use with Datafusion, checkout this crate and its examples: https://github.com/spiraldb/vortex/tree/develop/vortex-dataf...
comment by aduffy · 2024-10-14 · in Show HN: Vortex – a high-performance columnar file format -
▲ 249
Show HN: Vortex – a high-performance columnar file formatstory by gatesn · 2024-10-14 · 61 comments
-
…Vec<Vec<u8>> } Is there some optimal length for compressed given the 255 symbols limit? [1] https://github.com/spiraldb/vortex [2] https://github.com/apache/datafusion
comment by jcgrillo · 2024-09-13 · in Random access string compression with FSST and Rust -
…to develop new methods to support them. We develop Vortex (our core storage primitive) in the open https://github.com/spiraldb/vortex and currently are looking to hire more people to our 5 person team to help build our product. Tech: Rust,…
comment by robert3005 · 2024-05-02 · in Ask HN: Who is hiring? (May 2024)