datachain-ai/datachain
View on GitHub ↗ ★ 2,830 Python
The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure
17 mentions on Hacker News by 5 people: 12 stories, 5 comments · first 2024-07-23 · latest 2024-11-04
20082026
-
▲ 163
DataChain: DBT for Unstructured Datastory by shcheklein · 2024-11-04 · 26 comments
-
…WebDataset and can stream from tar archives and filter images by metadata. WebDataset example: https://github.com/iterative/datachain/blob/main/examples/mu...
comment by dmpetrov · 2024-10-20 · in Data Version Control -
…see DVC on the front page! Happy to answer any questions about DVC and our sister project DataChain https://github.com/iterative/datachain that does data versioning with a bit different assumptions: no file copy and built-in data…
comment by dmpetrov · 2024-10-19 · in Data Version Control -
▲ 1
DataChain: Pythonic AI Data Warehousestory by shcheklein · 2024-10-18 · 0 comments
-
▲ 1
Tool to prepare, curate, version datasets for AI/MLstory by shcheklein · 2024-10-04 · 0 comments
-
▲ 2
DataChain: Prepare and curate datasets for AI/MLstory by shcheklein · 2024-09-27 · 0 comments
-
▲ 3
DataChain: Prepare and curate datasets for AI/MLstory by shcheklein · 2024-09-19 · 0 comments
-
▲ 2
DataChain: Prepare and curate datasets for AI/MLstory by shcheklein · 2024-09-06 · 0 comments
-
An out-of-memory dataframe to wrangle unstructured data at scale - https://github.com/iterative/datachain
comment by shcheklein · 2024-08-24 · in Ask HN: What are you working on (August 2024)? -
▲ 1
DataChain: Dataframe to enrich, transform and analyze data for MLstory by shcheklein · 2024-08-23 · 0 comments
-
▲ 2
DataChain: A Pythonic data-frame library for artificial intelligencestory by mayop100 · 2024-08-17 · 1 comment
-
You can use the https://github.com/iterative/datachain mentioned by @dmpetrov to predict and draw (in SaaS) a molecular structure. Not only can you predict, but you can also - enrich the PDF data with external PDB data, - calculate and…
comment by mnrozhkov · 2024-08-12 · in Launch HN: Roe AI (YC W24) – AI-powered data warehouse to query multimodal data -
…a Python API that translates to SQL under the hood, which is pretty easy now with Pydantic. https://github.com/iterative/datachain WDYT?
comment by dmpetrov · 2024-08-09 · in Launch HN: Roe AI (YC W24) – AI-powered data warehouse to query multimodal data -
▲ 1
DataChain: Enrich, transform and curate datasets for MLstory by shcheklein · 2024-08-08 · 0 comments
-
▲ 1
DataChain: AI-dataframe to enrich, transform, analyze data from cloud storagesstory by thunderbong · 2024-08-06 · 0 comments
-
▲ 1
Show HN: DataChain – Tool to create, curate, version AI datasetsstory by shcheklein · 2024-07-25 · 1 comment
-
▲ 5
DataChain: Open-source tool to prepare and curate data for AI/MLstory by shcheklein · 2024-07-23 · 1 comment