EleutherAI/the-pile
View on GitHub ↗ ★ 1,679 Python
6 mentions on Hacker News by 3 people: 0 stories, 6 comments · first 2020-10-25 · latest 2024-03-07
20082026
-
…sad that it wasn't included to this day: [1] https://github.com/Hellisotherpeople/DebateSum [2] https://github.com/EleutherAI/the-pile/issues/56
comment by Der_Einzige · 2024-03-07 · in The Pile is a 825 GiB diverse, open-source language modelling data set (2020) -
…) into the pile, but they decided at the last minute not to add it: https://github.com/EleutherAI/the-pile/issues/56 I'm still a tiny bit salty about that, but the pile is a wonderful dataset regardless.
comment by Der_Einzige · 2023-07-11 · in The Pile: An 800GB dataset of diverse text for language modeling (2020) -
Anyone want to check if the book in question is in ThePile dataset?: https://github.com/EleutherAI/the-pile/blob/master/the_pile/...
comment by kristianp · 2023-07-10 · in Sarah Silverman is suing OpenAI and Meta for copyright infringement -
…in the fact that The Pile lets you pick and choose which portions of training data you want to use: https://github.com/EleutherAI/the-pile But of course, the irony is, even though The Pile is so flexible and modular, most people will just…
comment by sillysaurusx · 2021-07-04 · in GPT-J-6B – A 6 billion parameter, autoregressive text generation model -
…get it in. Makes me sad. I don't know why this company has decided to stop updating the pile... [1] https://github.com/EleutherAI/the-pile/issues/56
comment by Der_Einzige · 2021-06-09 · in GPT-J-6B: 6B JAX-Based Transformer -
…but The Pile is building the rest: https://twitter.com/arankomatsuzaki/status/13204141418954874... https://github.com/EleutherAI/The-Pile https://www.eleuther.ai/get-involved https://media.discordapp.net/attachments/735217892517216366/...…
comment by sillysaurusx · 2020-10-25 · in Books in .txt format for AI training purposes