Hacker GitHub

← All repos

jcpeterson/openwebtext

View on GitHub ↗ ★ 768 Python

Open clone of OpenAI's unreleased WebText dataset scraper. This version uses pushshift.io files instead of the API for speed.

4 mentions on Hacker News by 4 people: 3 stories, 1 comment · first 2019-02-26 · latest 2019-03-02

Mentions per year 4 mentions · busiest year 2019 (4)
20082026
AllStoriesComments NewestTopOldest
  1. ▲ 1
    Ask HN: Kickstarter for Data Science?
    story by wildermuthn · 2019-03-02 · 1 comment
  2. ▲ 3
    OpenWebText: Clone of OpenAI's Unreleased WebText Dataset Scraper
    story by ArtWomb · 2019-02-28 · 0 comments
  3. ▲ 2
    OpenWebText: Open Clone of OpenAI's GPT-2 WebText Dataset
    story by joshuacpeterson · 2019-02-28 · 0 comments
  4. …been working with a group that is trying to clone this dataset and make it publicly available ( https://github.com/jcpeterson/openwebtext ), and I have noticed quite a bit of code in the scraped dataset. Future releases of our dataset will…
    comment by glup · 2019-02-26 · in PHP code generated by GPT-2