Hacker GitHub

← All repos

EleutherAI/gpt-neox

View on GitHub ↗ ★ 7,471 Python

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

17 mentions on Hacker News by 16 people: 2 stories, 15 comments · first 2021-03-13 · latest 2023-12-28

Mentions per year 17 mentions · busiest year 2022 (8)
20082026
AllStoriesComments NewestTopOldest
  1. …There is also EleutherAI ( https://www.eleuther.ai/about/ ) with GPT-NeoX ( https://github.com/EleutherAI/gpt-neox ).
    comment by albertzeyer · 2023-02-20 · in Running large language models like ChatGPT on a single GPU
  2. …[1] https://langchain.readthedocs.io/en/latest/getting_started/g... [2] https://github.com/EleutherAI/gpt-neox
    comment by peterth3 · 2023-01-18 · in LangChain: Build AI apps with LLMs through composability
  3. For context, they're now working on a GPU driven version: https://github.com/EleutherAI/gpt-neox/
    comment by thebeardisred · 2022-12-29 · in First Open Source Alternative to ChatGPT Has Arrived
  4. …GPT-3 DaVinci: - https://the-decoder.com/gpt-3-alternative-eleutherai-release... GitHub Download: - https://github.com/EleutherAI/gpt-neox
    comment by O__________O · 2022-12-14 · in GPT-NeoX
  5. Yes. EleutherAI is doing it, probably one of many: https://www.eleuther.ai/projects/gpt-neox/ https://github.com/EleutherAI/gpt-neox https://arxiv.org/abs/2204.06745 They have a 20B parameter model. I think the primary dataset for these…
    comment by cottonseed · 2022-12-09 · in Could an open source/data GPT like chatbot be created?
  6. Here is an example of one general purpose open source LLM, probably the best you can get: https://github.com/EleutherAI/gpt-neox To manage your expectations it is nowhere as good as ChatGPT. If you are interested in programming only:…
    comment by freediver · 2022-12-07 · in Ask HN: When/where can we get an offline GPT3 type chatbot?
  7. You could follow EleutherAI's official guide: https://github.com/EleutherAI/gpt-neox You could also use a hosted service that proposes GPT-NeoX like https://nlpcloud.com or https://goose.ai
    comment by juliensalinas · 2022-10-26 · in GPT-3 can create both sides of an Interactive Fiction transcript
  8. The code is there: https://github.com/EleutherAI/gpt-neox
    comment by p1esk · 2022-06-23 · in YaLM-100B: Pretrained language model with 100B parameters
  9. …if they are truly useful. Suggest looking into GPT-NeoX and GPT-J instead. https://6b.eleuther.ai/ https://github.com/EleutherAI/gpt-neox/
    comment by Grimburger · 2022-06-02 · in Ask HN: Why are the likes of GPT3 and DALL-E not open to everyone?
  10. There's a PyTorch + DeepSpeed repository here: https://github.com/EleutherAI/gpt-neox
    comment by stellaathena · 2021-03-22 · in GPT Neo: open-source GPT model, with pretrained 1.3B & 2.7B weight models
  11. …is a model from the same group but using GPUs instead of TPUs, uses techniques from DeepSpeed: https://github.com/EleutherAI/gpt-neox/
    comment by MasterScrat · 2021-03-22 · in GPT Neo: open-source GPT model, with pretrained 1.3B & 2.7B weight models
  12. …are moving to a new repo[2] [1] https://twitter.com/arankomatsuzaki/status/13737326468119674... [2] https://github.com/EleutherAI/gpt-neox/
    comment by nl · 2021-03-21 · in GPT Neo: open-source GPT model, with pretrained 1.3B & 2.7B weight models
  13. Looks like they got it working recently https://github.com/EleutherAI/gpt-neox/pull/178
    comment by joshlk · 2021-03-13 · in Zero-3 Offload: Scale DL models to trillion parameters without code changes
  14. It seems like Zero-3 doesn't work for them: https://github.com/EleutherAI/gpt-neox/issues/171
    comment by ma2rten · 2021-03-13 · in Zero-3 Offload: Scale DL models to trillion parameters without code changes
  15. …The wider project intend to train a GPT-3 sized model and release it freely to the world. https://github.com/EleutherAI/gpt-neox
    comment by joshlk · 2021-03-13 · in Zero-3 Offload: Scale DL models to trillion parameters without code changes