Hacker GitHub

← All repos

apache/parquet-format

View on GitHub ↗ ★ 2,648 Thrift

Apache Parquet Format

6 mentions on Hacker News by 6 people: 0 stories, 6 comments · first 2023-04-04 · latest 2026-06-15

Mentions per year 6 mentions · busiest year 2023 (2)
20082026
AllStoriesComments NewestTopOldest
  1. …allows you to do all the tricks mentioned here, but on loosely typed data but chunk by chunk. [1] - https://github.com/apache/parquet-format/blob/master/Variant...
    comment by gopalv · 2026-06-15 · in How TimescaleDB compresses time-series data
  2. You can actually make those two bits more independent afaik. https://github.com/apache/parquet-format/blob/master/BloomFi... https://github.com/facebook/rocksdb/blob/main/util/bloom_imp... First one is useful for grasping the idea second…
    comment by ozgrakkurt · 2026-02-22 · in Two Bits Are Better Than One: making bloom filters 2x more accurate
  3. …called key_value_metadata in the FileMetadata structure; it sits in the footer of the file. See: https://github.com/apache/parquet-format/blob/master/src/mai... The technique described in the article, seems to use this key-value pair to…
    comment by jasim · 2025-07-14 · in Embedding user-defined indexes in Apache Parquet
  4. …never really worked with parquet or column based systems but just searching for parquet index shows https://github.com/apache/parquet-format/blob/master/PageInd... which describes exactly what I would expect. Maybe it doesn't work well, I…
    comment by dekhn · 2024-05-10 · in Buckets of Parquet Files Are Awful
  5. Right, there's all sorts of metadata and often stats included in any parquet file: https://github.com/apache/parquet-format#file-format The offsets of said metadata are well-defined (i.e. in the footer) so for S3 / blob storage so long as…
    comment by choppaface · 2023-11-17 · in Summing columns in remote Parquet files using DuckDB
  6. …to define if the timestamp should be interpreted as having Instant semantics or Local semantics. https://github.com/apache/parquet-format/blob/master/Logical... Still no option to include a TZ offset in the data (so the same datum can be…
    comment by markhuggins · 2023-04-04 · in Parquet: An efficient, binary file format for table data