Hacker GitHub

← All repos

EleutherAI/gpt-neo

View on GitHub ↗ ★ 8,251 Python archived

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

11 mentions on Hacker News by 11 people: 1 story, 10 comments · first 2021-01-01 · latest 2026-08-10

Mentions per year 11 mentions · busiest year 2021 (9)
20082026
  1. …(and others doing open work I haven't listed here) all prior to 2023 and the big Chatgpt moment. https://github.com/EleutherAI/gpt-neo/releases https://github.com/google-research/bert https://github.com/google-research/t5x If you're…
  2. Uhhh, weren't the EleutherAI folks ( https://github.com/EleutherAI/gpt-neo ) first?
  3. gpt-neo is the one I would keep my eye on. https://github.com/EleutherAI/gpt-neo
    comment by vorpalhex · 2021-12-16 · in GPT-3 APIs are now in public beta
  4. this one https://github.com/EleutherAI/gpt-neo ?
  5. …TPU quota was the only reason everyone was able to band together and start building GPT neo. https://github.com/EleutherAI/gpt-neo At least I was able to start a discord server that happened to get the original eleuther people together in…
  6. …it requires a bit of data engineering work to get operating and generating text (see the README: https://github.com/EleutherAI/gpt-neo ), and it's unclear currently if it's as good as GPT-3, even when comparing models apples-to-apples…
  7. …of GPT-3 freely available. The model is not as big, but the results are good for the size https://github.com/EleutherAI/gpt-neo https://twitter.com/BlancheMinerva/status/137399189661642752...
    comment by gattilorenz · 2021-03-24 · in GPT-3 tries pickup lines
  8. I tried the same prompt on the open-source recreation of OpenAI GPT-3 -- GPT Neo ( https://github.com/EleutherAI/gpt-neo ), specifically on their 2.7B model -- which should correspond to the smallest model in the article (Ada) that…
    comment by PufPufPuf · 2021-03-24 · in GPT-3 tries pickup lines
  9. ▲ 561
    GPT Neo: open-source GPT model, with pretrained 1.3B & 2.7B weight models
    story by pizza · 2021-03-21 · 127 comments
  10. https://github.com/EleutherAI/gpt-neo (Couldn't find it on the website)
  11. …we can look into doing so though. We are planning on making our GPT-3 replica public facing though. https://github.com/EleutherAI/gpt-neo