rom1504/img2dataset
View on GitHub ↗ ★ 4,461 Python
Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.
11 mentions on Hacker News by 10 people: 3 stories, 8 comments · first 2022-10-03 · latest 2025-08-30
20082026
-
…polar opposite your definition. - https://arstechnica.com/gadgets/2024/06/report-new-apple-int... - https://github.com/rom1504/img2dataset/issues/293 It's also just pure laziness to label me as "hysterical" when PR departments of companies…
comment by soraminazuki · 2025-08-30 · in Updates to Consumer Terms and Privacy Policy -
▲ 5
Do Not Train" Meta Tags: The Robots.txt of AI – Will Anyone Respect Them?story by alissa_v · 2025-04-25 · 7 comments
-
…him money as there are no punitive damages in German law. [0] https://laion.ai/blog/laion-5b/ [1] https://github.com/rom1504/img2dataset [2] https://www.alltageinesfotoproduzenten.de/2023/04/24/laion-e... [3]…
comment by davidktr · 2023-04-26 · in AI used photographer’s photos for training, then slapped him with an invoice -
…images, and choose to actively not consent to their images being collected, see [AI use impact]( https://github.com/rom1504/img2dataset#ai-use-impact ). AI training would not be possible without the contribution of artists, and it is the…
comment by deanCommie · 2023-04-26 · in Please make this tool “opt-in” by default -
…reporting actual disruption, it doesn't have robots.txt support. When people complained (eg in https://github.com/rom1504/img2dataset/issues/48 ), the author's stance was basically "PRs welcome". It looks like a third party recently…
comment by jimrandomh · 2023-04-25 · in An AI Scraping Tool Is Overwhelming Websites with Traffic -
…and download all images, you may pass --disallowed_header_directives '[]' See [AI use impact]( https://github.com/rom1504/img2dataset#ai-use-impact ) to understand better why you may decide to enable or disable this feature. ``` This does…
comment by deanCommie · 2023-04-24 · in Please make this tool “opt-in” by default -
rom1504 /img2dataset https://github.com/rom1504/img2dataset https://github.com/rom1504/img2dataset#opt-out-directives
comment by rolph · 2023-04-23 · in Please make this tool “opt-in” by default -
▲ 64
Please make this tool “opt-in” by defaultstory by _Microft · 2023-04-23 · 46 comments
-
▲ 3
Img2dataset: Turns large sets of image URLs to an image datasetstory by wildpeaks · 2023-04-23 · 0 comments
-
…storage space you need to remember the pixels. The stable diffusion 1.5 checkpoint is 7gb. (2) 1 https://github.com/rom1504/img2dataset/blob/main/dataset_exa... 2 https://huggingface.co/runwayml/stable-diffusion-v1-5/tree/m...
comment by pksebben · 2023-02-06 · in Stable Attribution -
You can download it here: https://github.com/rom1504/img2dataset/blob/main/dataset_exa... You probably would want to stop after getting the metadata, unless you have 240TB available for the images :) More details and links to dataset…
comment by moyix · 2022-10-03 · in How a Stable Diffusion prompt changes its output for the style of 1500 artists