Hacker GitHub

← All repos

vortex-data/vortex

View on GitHub ↗ ★ 3,297 Rust

An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.

19 mentions on Hacker News by 18 people: 6 stories, 13 comments · first 2024-05-02 · latest 2026-07-30

Mentions per year 19 mentions · busiest year 2025 (11)
20082026
AllStoriesComments NewestTopOldest
  1. …Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation. https://github.com/vortex-data/vortex Vortex also has Segment Profiling and Adaptive Encoding. "What is Vortex? Columnar File Format…
    comment by westurner · 2026-07-30 · in Pgrust v0.2: Now faster than Postgres and Clickhouse Latest
  2. You should take a look at https://github.com/vortex-data/vortex !
    comment by ConnorTsui20 · 2026-06-24 · in F3
  3. …follow on post where we show how we used this to optimize an FSST decompression kernel for vortex ( https://github.com/vortex-data/vortex ).
    comment by gnurizen · 2026-06-15 · in Show HN: Continuous Nvidia CUDA PC Sampling Profiler
  4. They seem to have removed the emojis since I posted my comment: https://github.com/vortex-data/vortex/commit/8294dd665869a72...
    comment by xigoi · 2025-11-21 · in Vortex: An extensible, state of the art columnar file format
  5. …time on GPUs, so a fast path straight from these Vortex files to GPU memory seems promising. [1] https://github.com/vortex-data/vortex/issues/2116
    comment by kipukun · 2025-11-20 · in Vortex: An extensible, state of the art columnar file format
  6. There's this: https://bench.vortex.dev/ , which links to https://github.com/vortex-data/vortex/tree/develop/bench-vor... . I haven't tried pulling the repo or anything but it seems like they might be runnable? Of course I don't know what…
    comment by msteffen · 2025-09-11 · in Spiral
  7. …WebGL enabled or supported - the main page is just a cute 3D landing page. You may be interested in https://github.com/vortex-data/vortex which of course has an overview and links to their docs and benchmark pages.
    comment by miloignis · 2025-09-11 · in Spiral
  8. …The file format they created and put into the LF, Vortex, is very welcome innovation in the space: https://github.com/vortex-data/vortex I'm excited to start doing some experimentation with Vortex to see how it can improve our products.…
    comment by pauldix · 2025-09-11 · in Spiral
  9. Any comparison with https://github.com/vortex-data/vortex ? Also any plans to integrate with polars?
    comment by jmakov · 2025-07-24 · in The FastLanes File Format [pdf]
  10. Off the top of my head: - Vortex https://github.com/vortex-data/vortex - Lance https://github.com/lancedb/lance - Nimble https://github.com/facebookincubator/nimble There are also a bunch of ideas coming out of academia, but I don't know…
    comment by MasterIdiot · 2025-07-15 · in Embedding user-defined indexes in Apache Parquet
  11. We have a TableProvider for use with Datafusion, checkout this crate and its examples: https://github.com/spiraldb/vortex/tree/develop/vortex-dataf...
    comment by aduffy · 2024-10-14 · in Show HN: Vortex – a high-performance columnar file format
  12. …Vec<Vec<u8>> } Is there some optimal length for compressed given the 255 symbols limit? [1] https://github.com/spiraldb/vortex [2] https://github.com/apache/datafusion
    comment by jcgrillo · 2024-09-13 · in Random access string compression with FSST and Rust
  13. …to develop new methods to support them. We develop Vortex (our core storage primitive) in the open https://github.com/spiraldb/vortex and currently are looking to hire more people to our 5 person team to help build our product. Tech: Rust,…
    comment by robert3005 · 2024-05-02 · in Ask HN: Who is hiring? (May 2024)