EleutherAI/gpt-neox
View on GitHub ↗ ★ 7,471 Python
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
17 mentions on Hacker News by 16 people: 2 stories, 15 comments · first 2021-03-13 · latest 2023-12-28
20082026
-
▲ 1
GPT-Neoxstory by tosh · 2023-12-28 · 0 comments
-
…There is also EleutherAI ( https://www.eleuther.ai/about/ ) with GPT-NeoX ( https://github.com/EleutherAI/gpt-neox ).
comment by albertzeyer · 2023-02-20 · in Running large language models like ChatGPT on a single GPU -
…[1] https://langchain.readthedocs.io/en/latest/getting_started/g... [2] https://github.com/EleutherAI/gpt-neox
comment by peterth3 · 2023-01-18 · in LangChain: Build AI apps with LLMs through composability -
For context, they're now working on a GPU driven version: https://github.com/EleutherAI/gpt-neox/
comment by thebeardisred · 2022-12-29 · in First Open Source Alternative to ChatGPT Has Arrived -
Yes. EleutherAI is doing it, probably one of many: https://www.eleuther.ai/projects/gpt-neox/ https://github.com/EleutherAI/gpt-neox https://arxiv.org/abs/2204.06745 They have a 20B parameter model. I think the primary dataset for these…
comment by cottonseed · 2022-12-09 · in Could an open source/data GPT like chatbot be created? -
Here is an example of one general purpose open source LLM, probably the best you can get: https://github.com/EleutherAI/gpt-neox To manage your expectations it is nowhere as good as ChatGPT. If you are interested in programming only:…
comment by freediver · 2022-12-07 · in Ask HN: When/where can we get an offline GPT3 type chatbot? -
You could follow EleutherAI's official guide: https://github.com/EleutherAI/gpt-neox You could also use a hosted service that proposes GPT-NeoX like https://nlpcloud.com or https://goose.ai
comment by juliensalinas · 2022-10-26 · in GPT-3 can create both sides of an Interactive Fiction transcript -
▲ 2
Show HN: Use GPT-NeoX to generate quotesstory by hnipun · 2022-08-14 · 1 comment
-
The code is there: https://github.com/EleutherAI/gpt-neox
comment by p1esk · 2022-06-23 · in YaLM-100B: Pretrained language model with 100B parameters -
…if they are truly useful. Suggest looking into GPT-NeoX and GPT-J instead. https://6b.eleuther.ai/ https://github.com/EleutherAI/gpt-neox/
comment by Grimburger · 2022-06-02 · in Ask HN: Why are the likes of GPT3 and DALL-E not open to everyone? -
There's a PyTorch + DeepSpeed repository here: https://github.com/EleutherAI/gpt-neox
comment by stellaathena · 2021-03-22 · in GPT Neo: open-source GPT model, with pretrained 1.3B & 2.7B weight models -
…is a model from the same group but using GPUs instead of TPUs, uses techniques from DeepSpeed: https://github.com/EleutherAI/gpt-neox/
comment by MasterScrat · 2021-03-22 · in GPT Neo: open-source GPT model, with pretrained 1.3B & 2.7B weight models -
…are moving to a new repo[2] [1] https://twitter.com/arankomatsuzaki/status/13737326468119674... [2] https://github.com/EleutherAI/gpt-neox/
comment by nl · 2021-03-21 · in GPT Neo: open-source GPT model, with pretrained 1.3B & 2.7B weight models -
Looks like they got it working recently https://github.com/EleutherAI/gpt-neox/pull/178
comment by joshlk · 2021-03-13 · in Zero-3 Offload: Scale DL models to trillion parameters without code changes -
It seems like Zero-3 doesn't work for them: https://github.com/EleutherAI/gpt-neox/issues/171
comment by ma2rten · 2021-03-13 · in Zero-3 Offload: Scale DL models to trillion parameters without code changes -
…The wider project intend to train a GPT-3 sized model and release it freely to the world. https://github.com/EleutherAI/gpt-neox
comment by joshlk · 2021-03-13 · in Zero-3 Offload: Scale DL models to trillion parameters without code changes