EleutherAI/gpt-neo
View on GitHub ↗ ★ 8,251 Python archived
An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
11 mentions on Hacker News by 11 people: 1 story, 10 comments · first 2021-01-01 · latest 2026-08-10
20082026
-
…(and others doing open work I haven't listed here) all prior to 2023 and the big Chatgpt moment. https://github.com/EleutherAI/gpt-neo/releases https://github.com/google-research/bert https://github.com/google-research/t5x If you're…
comment by canyon289 · 2026-08-10 · in Mark Zuckerberg attacks 'closed' AI rivals as Meta returns to open models -
Uhhh, weren't the EleutherAI folks ( https://github.com/EleutherAI/gpt-neo ) first?
comment by thebeardisred · 2022-12-29 · in First Open Source Alternative to ChatGPT Has Arrived -
gpt-neo is the one I would keep my eye on. https://github.com/EleutherAI/gpt-neo
comment by vorpalhex · 2021-12-16 · in GPT-3 APIs are now in public beta -
this one https://github.com/EleutherAI/gpt-neo ?
comment by gjvc · 2021-09-21 · in Ask HN: Has anyone used the open source implementation of GPT-3 -
…TPU quota was the only reason everyone was able to band together and start building GPT neo. https://github.com/EleutherAI/gpt-neo At least I was able to start a discord server that happened to get the original eleuther people together in…
comment by sillysaurusx · 2021-07-04 · in GPT-J-6B – A 6 billion parameter, autoregressive text generation model -
…it requires a bit of data engineering work to get operating and generating text (see the README: https://github.com/EleutherAI/gpt-neo ), and it's unclear currently if it's as good as GPT-3, even when comparing models apples-to-apples…
comment by minimaxir · 2021-03-29 · in The makers of Eleuther hope it will be an open source alternative to GPT-3 -
…of GPT-3 freely available. The model is not as big, but the results are good for the size https://github.com/EleutherAI/gpt-neo https://twitter.com/BlancheMinerva/status/137399189661642752...
comment by gattilorenz · 2021-03-24 · in GPT-3 tries pickup lines -
I tried the same prompt on the open-source recreation of OpenAI GPT-3 -- GPT Neo ( https://github.com/EleutherAI/gpt-neo ), specifically on their 2.7B model -- which should correspond to the smallest model in the article (Ada) that…
comment by PufPufPuf · 2021-03-24 · in GPT-3 tries pickup lines -
▲ 561
GPT Neo: open-source GPT model, with pretrained 1.3B & 2.7B weight modelsstory by pizza · 2021-03-21 · 127 comments
-
https://github.com/EleutherAI/gpt-neo (Couldn't find it on the website)
comment by wumms · 2021-01-18 · in GPT-Neo – Building a GPT-3-sized model, open source and free -
…we can look into doing so though. We are planning on making our GPT-3 replica public facing though. https://github.com/EleutherAI/gpt-neo
comment by stellaathena · 2021-01-01 · in The Pile: An 800GB Dataset of Diverse Text for Language Modeling