jcpeterson/openwebtext
View on GitHub ↗ ★ 768 Python
Open clone of OpenAI's unreleased WebText dataset scraper. This version uses pushshift.io files instead of the API for speed.
4 mentions on Hacker News by 4 people: 3 stories, 1 comment · first 2019-02-26 · latest 2019-03-02
20082026
-
…been working with a group that is trying to clone this dataset and make it publicly available ( https://github.com/jcpeterson/openwebtext ), and I have noticed quite a bit of code in the scraped dataset. Future releases of our dataset will…
comment by glup · 2019-02-26 · in PHP code generated by GPT-2