Hacker GitHub

← All repos

minimaxir/gpt-2-simple

View on GitHub ↗ ★ 3,404 Python

Python package to easily retrain OpenAI's GPT-2 text-generating model on new texts

19 mentions on Hacker News by 10 people: 1 story, 18 comments · first 2019-04-19 · latest 2025-12-14

Mentions per year 19 mentions · busiest year 2019 (10)
20082026
  1. …instead we fine-tuned GPT-2 instead. (As was the fashion at the time!) We used this one, I think https://github.com/minimaxir/gpt-2-simple I think it took 2-3 hours on my friend's Nvidia something. The result was absolutely hilarious. It…
  2. …I ran it on Google Colab. My friend ran it on his GPU, it should be doable on most modern-ish GPUs. https://github.com/minimaxir/gpt-2-simple I tried doing something with this a few months ago though and it was a bit of a hassle to get…
  3. …studying this technology I literally publish open-source packages on how to use this technology. https://github.com/minimaxir/gpt-2-simple https://github.com/minimaxir/aitextgen
  4. …released a wrapper to streamline that code and make it much easier to finetune on your own data. ( https://github.com/minimaxir/gpt-2-simple ) Nowadays, the easiest way to interact with GPT-2 is to use the transformers library (…
    comment by minimaxir · 2020-12-27 · in Does GPT-2 Know Your Phone Number?
  5. …own text (if you've played the free version of AI Dungeon, this is how they trained their model): https://github.com/minimaxir/gpt-2-simple
  6. …GPT-2 on your own text (a la AI Dungeon), I'd suggest using gpt-2-simple and deploying with Cortex: https://github.com/minimaxir/gpt-2-simple Lastly, by following this example, you can deploy your API locally (where inference will probably…
  7. I've been following minimaxir's work with GPT-2 for a while - I've tried building things on https://github.com/minimaxir/gpt-2-simple for example - and this looks like a HUGE leap forward in terms of developer usability. The old stuff was…
  8. See the notes and Colab notebook in the source project repo: https://github.com/minimaxir/gpt-2-simple I am working on a new text generation package which should be even more simple to use.
    comment by minimaxir · 2020-05-05 · in Show HN: I trained GPT-2 to write like Goop
  9. …litterature was fine-tuned on 300Kb of french love poetry and love songs. We used GPT-2-Simple https://github.com/minimaxir/gpt-2-simple and GPT-2-Cloud-Run https://github.com/minimaxir/gpt-2-cloud-run by Max Woolf. The base french model…
  10. …You can train your own GPT-2 bot using minimaxir's GPT2-simple https://github.com/minimaxir/gpt-2-simple
    comment by _5659 · 2019-10-30 · in Ask HN: Do you have personal bots?
  11. …to reproduce see http://trumptwitterarchive.com/archive and then you just follow the directions on https://github.com/minimaxir/gpt-2-simple
  12. About GPT-2 finetuning: I have a Python package which makes the process straightforward ( https://github.com/minimaxir/gpt-2-simple ), along with a Jupyter notebook to streamline it further ( https://colab.research.google.com/drive/1VLG8e7Y…
  13. For finetuning GPT-2 on custom text, my gpt-2-simple package ( https://github.com/minimaxir/gpt-2-simple ) gets close to going OOM when finetuning the 345M model, even on a 16GB VRAM server GPU. Doubling the size of the model with the 774M…
    comment by minimaxir · 2019-08-20 · in GPT-2: 6-Month Follow-Up
  14. …sentence and it will generate a few paragraphs that sound like Trump completing the thought. I used https://github.com/minimaxir/gpt-2-simple and some other stuff to re-train, with Starlette being the python web server. I'll write up a…
  15. …too long to train? You could easily finetune a pretrained GPT2 model on your lovecraft dataset : https://github.com/minimaxir/gpt-2-simple
  16. …believe has powered some of the GPT-2 projects you might've seen recently like Talk to Transformer: https://github.com/minimaxir/gpt-2-simple
    comment by gwern · 2019-06-19 · in This Marketing Blog Does Not Exist
  17. …cool! You mentioned OpenAI in another post - it's not that hard to use the GPT-2 model. Check out https://github.com/minimaxir/gpt-2-simple for a quickstart. Would be curious to see how the music generation goes if you re-train your data…
  18. …tools to streamline GPT-2 text generation: I'm currently porting the code above to gpt-2-simple ( https://github.com/minimaxir/gpt-2-simple ) to allow easy finetuning/generation, and am also working on a way to quickly build an API/client…
    comment by minimaxir · 2019-05-05 · in OpenAI releases larger GPT-2 model
  19. ▲ 6
    Show HN: Python tool to easily retrain OpenAI's GPT-2 text-gen model on new text
    story by minimaxir · 2019-04-19 · 0 comments