Hacker GitHub

← All repos

datachain-ai/datachain

View on GitHub ↗ ★ 2,830 Python

The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure

17 mentions on Hacker News by 5 people: 12 stories, 5 comments · first 2024-07-23 · latest 2024-11-04

Mentions per year 17 mentions · busiest year 2024 (17)
20082026
AllStoriesComments NewestTopOldest
  1. …WebDataset and can stream from tar archives and filter images by metadata. WebDataset example: https://github.com/iterative/datachain/blob/main/examples/mu...
    comment by dmpetrov · 2024-10-20 · in Data Version Control
  2. …see DVC on the front page! Happy to answer any questions about DVC and our sister project DataChain https://github.com/iterative/datachain that does data versioning with a bit different assumptions: no file copy and built-in data…
    comment by dmpetrov · 2024-10-19 · in Data Version Control
  3. An out-of-memory dataframe to wrangle unstructured data at scale - https://github.com/iterative/datachain
    comment by shcheklein · 2024-08-24 · in Ask HN: What are you working on (August 2024)?
  4. You can use the https://github.com/iterative/datachain mentioned by @dmpetrov to predict and draw (in SaaS) a molecular structure. Not only can you predict, but you can also - enrich the PDF data with external PDB data, - calculate and…
    comment by mnrozhkov · 2024-08-12 · in Launch HN: Roe AI (YC W24) – AI-powered data warehouse to query multimodal data
  5. …a Python API that translates to SQL under the hood, which is pretty easy now with Pydantic. https://github.com/iterative/datachain WDYT?
    comment by dmpetrov · 2024-08-09 · in Launch HN: Roe AI (YC W24) – AI-powered data warehouse to query multimodal data