Hacker GitHub

← All repos

openai/gpt-2

View on GitHub ↗ ★ 25,011 Python archived

Code for the paper "Language Models are Unsupervised Multitask Learners"

39 mentions on Hacker News by 35 people: 5 stories, 34 comments · first 2019-02-14 · latest 2026-05-03

Mentions per year 39 mentions · busiest year 2019 (15)
20082026
AllStoriesComments NewestTopOldest
  1. …a product recognize that LLMs will not lead to human-equivalent general intelligence. [3] [0] https://github.com/openai/gpt-2 [1] https://en.wikipedia.org/wiki/G%C3%B6del's_incompleteness_th... [2] https://www.cambridge.org/core/journals/th…
    comment by solid_fuel · 2026-05-03 · in When Dawkins met Claude – Could this AI be conscious?
  2. …From what I can tell GPT-2 was released in 2019... https://huggingface.co/openai-community/gpt2 https://github.com/openai/gpt-2/blob/master/model_card.md
    comment by subroutine · 2026-04-08 · in OpenAI says its new model GPT-2 is too dangerous to release (2019)
  3. curl -sL https://github.com/openai/gpt-2 | grep -iE 'Star |stars' This still shows star data, so I feel like this is probably a bug.
    comment by ramoz · 2026-03-07 · in GitHub appears to be hiding repo stars for signed-out users
  4. …on a Transformer is quite short. How short depends on how you count the `import` statements in https://github.com/openai/gpt-2/blob/master/src/model.py and https://github.com/openai/gpt-2/blob/master/src/sample.py etc. Spreadsheets…
    comment by ben_w · 2025-02-26 · in A new proposal for how mind emerges from matter
  5. …the highest but the point is each byte is mapped to another printable unicode character. See https://github.com/openai/gpt-2/blob/9b63575ef42771a015060c9... And the actual list of characters: https://github.com/rbitr/llm.f90/blob/dev/phi2/p…
    comment by andy99 · 2024-03-17 · in Parsing URLs in Python
  6. …put on arXiv https://arxiv.org/abs/1810.03993 2019: Major ML organizations start using model cards https://github.com/openai/gpt-2/blob/master/model_card.md 2020: Model cards become fairly standard https://blog.research.google/2020/07/intro…
    comment by nsagent · 2023-12-27 · in Will scaling work?
  7. https://github.com/openai/gpt-2
    comment by Zambyte · 2023-11-20 · in Sam Altman is still trying to return as OpenAI CEO
  8. …few) open models from OpenAI, you can just run it locally, why would you use their API for this? https://github.com/openai/gpt-2
    comment by gigel82 · 2023-07-08 · in PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS
  9. …eg: GPT-2: paper https://d4mucfpksywv.cloudfront.net/better-language-models/l... with code: https://github.com/openai/gpt-2 , output dataset https://github.com/openai/gpt-2-output-dataset and a bunch of blog posts with all manner of…
    comment by seanhunter · 2023-07-04 · in OpenAI temporarily disables the Browse with Bing beta feature
  10. …document [0] that describes the training data for GPT-2 makes this assertion hilarious to me. [0]: https://github.com/openai/gpt-2/blob/master/model_card.md#da...
    comment by mcculley · 2023-05-22 · in Don Knuth plays with ChatGPT
  11. You can find GPT-2's training dataset list - at a high level - in the GPT-2 repository on Github: https://github.com/openai/gpt-2/blob/master/model_card.md#da... However, OpenAI goes dark after that regarding the 'data soup' that was fed…
    comment by lobstersammich · 2023-05-20 · in Don Knuth plays with ChatGPT
  12. …2019, predating the first press for GPT-2 by a few days (was probably made public Feb 14 though) - https://github.com/openai/gpt-2/commit/c2dae27c1029770cea409... May 28 2020, timed alongside the press news for GPT-3 -…
    comment by eganist · 2022-04-06 · in Dall-E 2
  13. …That's probably not going to be the case. For example, take a look at the GPT-2 source code https://github.com/openai/gpt-2/blob/master/src/model.py It's only a few hundred lines of code.
    comment by jart · 2022-01-15 · in Ask HN: Why are we accepting ageism in tech as something immutable?
  14. The GPT-2 weights were released by OpenAI when GPT-2 was released. ( https://github.com/openai/gpt-2 ) Around that time (since no one else was doing it) I released a wrapper to streamline that code and make it much easier to finetune on…
    comment by minimaxir · 2020-12-27 · in Does GPT-2 Know Your Phone Number?
  15. Unless I'm missing some subtext, yes right here: https://github.com/openai/gpt-2 To quote: > WARNING: Samples are unfiltered and may contain offensive content.
    comment by inquirerofsorts · 2020-10-06 · in Show HN: Chat bot powered by GPT-3
  16. …unrelated one. However, it seems like there is a bug with this re how the nsheppard fork works: https://github.com/openai/gpt-2/issues/222 Even if you're not doing this, you shouldn't be getting gibberish, so you likely have another issue…
    comment by serendipityrecs · 2020-09-17 · in Train a GPT-2-1.5b Text-Generating Model with GPU for Free
  17. …so easily. GPT-2 was trained on TPUs. (There are explicit references to TPUs in the source code: https://github.com/openai/gpt-2/blob/0574c5708b094bfa0b0f6df... ) GPT-3 was trained on a GPU cluster probably because of Microsoft's…
    comment by sillysaurusx · 2020-09-14 · in Nvidia to Acquire Arm for $40B
  18. Agreed re: OpenAI's GPT implementation. It took roughly a year to appreciate how simple it is. https://github.com/openai/gpt-2/blob/0574c5708b094bfa0b0f6df... Especially compared to StyleGAN, BERT, or pretty much anything else. I used to…
    comment by sillysaurusx · 2020-08-17 · in Karpathy's MinGPT
  19. …sabotage with GPT-2 and with GPT-3 they simply didn't open source it. For GPT-2, their repository ( https://github.com/openai/gpt-2 ) is archived. Which is as good as saying that the project is abandoned and will receive no updates. The…
    comment by csomar · 2020-07-20 · in OpenAI should now change their name to ClosedAI
  20. …> We are still considering release of the larger models. Is there something I'm missing? 1. https://github.com/openai/gpt-2
    comment by moonchild · 2020-07-20 · in OpenAI should now change their name to ClosedAI
  21. GPT-2 https://openai.com/blog/gpt-2-1-5b-release/ https://talktotransformer.com/ https://github.com/openai/gpt-2 (GPT-2 docker image needs a version tweak to get it working) and BERT: https://github.com/google-research/bert
    comment by dana321 · 2020-02-23 · in Ask HN: I'm away from the software industry since 2017; what has happened since?
  22. …past the original question. [1] https://github.com/google-research/bert/blob/master/modeling... [2] https://github.com/openai/gpt-2/blob/master/src/model.py#L17...
    comment by Voloskaya · 2020-02-11 · in Turing-NLG: A 17B-parameter language model
  23. Tangent rant. I'm skimming over some of the code at https://github.com/openai/gpt-2/blob/master/src/model.py and I can't help but feel frustrated at how unreadable this stuff is. 1. Why is it acceptable to have single-letter variable names…
    comment by 490d0aff0ee8 · 2019-11-05 · in OpenAI Releases Largest GPT-2 Text Generation Model
  24. Paper: https://d4mucfpksywv.cloudfront.net/papers/GPT_2_Report.pdf Code: https://github.com/openai/gpt-2
    comment by epoch_100 · 2019-11-05 · in OpenAI Releases Largest GPT-2 Text Generation Model
  25. …the usually insightful comments here when compared to other sites. [1] https://xkcd.com/810/ [2] https://github.com/openai/gpt-2
    comment by thisBrian · 2019-08-22 · in Ask HN: How can HN allow login without an email and not be full of bots?
  26. Well it was just a belief. I may be wrong. I asked them by curiosity https://github.com/openai/gpt-2/issues/168 So we will know.
    comment by The_rationalist · 2019-08-20 · in GPT-2: 6-Month Follow-Up
  27. Using this in conjunction with GPT-2 ( https://github.com/openai/gpt-2 ) to make full stories out of these sentences should be fun. Update: It's at least "interesting" if not fun; here's a story generated from the 2019 winner using the…
    comment by johnhenry · 2019-07-15 · in The Lyttle Lytton Contest
  28. You can, see: https://github.com/openai/gpt-2/blob/master/DEVELOPERS.md . But this is for a smaller version of GPT-2 (~400M parameters). Since the bigger model (2B parameters) was deemed too dangerous by OpenAI.
    comment by Voloskaya · 2019-05-12 · in The AI That's Too Dangerous to Release
  29. …just to have an idea) Also, would be interesting to see how it compares to the recent GPT-2 ( https://github.com/openai/gpt-2 )
    comment by antpls · 2019-04-21 · in Generate Hacker News Comments from Titles
  30. How does this compare to the gpt by openai https://github.com/openai/gpt-2 ?
    comment by ganeshkrishnan · 2019-03-15 · in Show HN: This Question Does Not Exist
  31. …internet text. They probably read a lot of embarrassing text they didn't share, imagine that. 0. https://github.com/openai/gpt-2/
    comment by angel_j · 2019-02-19 · in Dear OpenAI: Please Open Source Your Language Model
  32. The code is out ( https://github.com/openai/gpt-2 ), just not the larger model itself.
    comment by minimaxir · 2019-02-19 · in Dear OpenAI: Please Open Source Your Language Model
  33. It's beautiful that the reduced model itself is only 175 lines of Python code, thanks to TensorFlow : https://github.com/openai/gpt-2/blob/master/src/model.py
    comment by antpls · 2019-02-17 · in Better Language Models and Their Implications
  34. Thank you! We've released 500 random unconditional samples from GPT-2 at https://github.com/openai/gpt-2/blob/master/gpt2-samples.txt
    comment by wuthefwasthat · 2019-02-14 · in Better Language Models and Their Implications