Hacker GitHub

← All repos

lance-format/lance

View on GitHub ↗ ★ 7,242 Rust

Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

10 mentions on Hacker News by 6 people: 1 story, 9 comments · first 2023-05-31 · latest 2026-07-30

Mentions per year 10 mentions · busiest year 2024 (4)
20082026
AllStoriesComments NewestTopOldest
  1. …lancedb's data format; Lancedb/lance works with [Pandas, DuckDB, Polars, PyArrow,]; https://github.com/lancedb/lance Narwhals' df interface (Python) https://narwhals-dev.github.io/narwhals/ substrait's portable query plans:…
    comment by westurner · 2026-07-30 · in Pgrust v0.2: Now faster than Postgres and Clickhouse Latest
  2. …[pandas, Polars, cuDF, Modin] > Lancedb/lance works with [Pandas, DuckDB, Polars, Pyarrow,]; https://github.com/lancedb/lance SymPy has Solvers for ODEs and PDEs and other libraries do convex optimization. SymPy also has lambdify to…
    comment by westurner · 2025-10-08 · in Translating Cython to Mojo, a first attempt
  3. Off the top of my head: - Vortex https://github.com/vortex-data/vortex - Lance https://github.com/lancedb/lance - Nimble https://github.com/facebookincubator/nimble There are also a bunch of ideas coming out of academia, but I don't know…
    comment by MasterIdiot · 2025-07-15 · in Embedding user-defined indexes in Apache Parquet
  4. …LanceDB folks), Nimble (from Meta folks, formerly known as Alpha); I think there are a few others https://github.com/lancedb/lance https://github.com/facebookincubator/nimble
    comment by dkdcio · 2025-07-15 · in Embedding user-defined indexes in Apache Parquet
  5. How does this relate to https://github.com/lancedb/lance
    comment by datascientist · 2024-11-05 · in DataChain: DBT for Unstructured Data
  6. …between [pandas, Polars, cuDF, Modin] Lancedb/lance works with [Pandas, DuckDB, Polars, Pyarrow,]; https://github.com/lancedb/lance It may already be supported through pandas?
    comment by westurner · 2024-07-13 · in Narwhals and scikit-Lego came together to achieve dataframe-agnosticism
  7. …: > lancedb/lance is faster than pandas with dtype_backend="arrow" and has a vector index From https://github.com/lancedb/lance : > Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code…
    comment by westurner · 2024-07-06 · in Txtai – A Strong Alternative to ChromaDB and LangChain for Vector Search and RAG
  8. How do Parquet, Lance, and Nimble compare? lancedb/lance: https://github.com/lancedb/lance : > Modern columnar data format for ML. Convert from Parquet in 2-lines of code for 100x faster random access, a vector index, data versioning, and…
    comment by westurner · 2024-04-11 · in Nimble: A new columnar file format by Meta [video]
  9. …But we are starting to see other contenders that are optimized more for lower latency like lance https://github.com/lancedb/lance
    comment by hawaiianSpork · 2023-12-30 · in Understanding Parquet, Iceberg and Data Lakehouses