Hacker GitHub

← All repos

openai/gpt-3

View on GitHub ↗ ★ 15,691 archived

GPT-3: Language Models are Few-Shot Learners

22 mentions on Hacker News by 20 people: 4 stories, 18 comments · first 2020-05-29 · latest 2024-05-13

Mentions per year 22 mentions · busiest year 2020 (11)
20082026
AllStoriesComments NewestTopOldest
  1. …- like dataset must be 90%+ English to not fall apart? 1: https://arxiv.org/html/2403.04652v1 2: https://github.com/openai/gpt-3/blob/master/dataset_statisti...
    comment by numpad0 · 2024-05-13 · in Yi 1.5
  2. …can't find it. Most LLMs are trained on English overwhelmingly. GPT-3 had a 92.6% English dataset. https://github.com/openai/gpt-3/blob/master/dataset_statisti... That the models are as proficient as they are is evidence enough of…
    comment by famouswaffles · 2024-04-29 · in GPT-4.5 or GPT-5 being tested on LMSYS?
  3. …of blog posts with all manner of details GPT-3: paper https://arxiv.org/abs/2005.14165 dataset https://github.com/openai/gpt-3 etc etc.
    comment by seanhunter · 2023-07-04 · in OpenAI temporarily disables the Browse with Bing beta feature
  4. …English and ~1.5% of German, which means it saw more "die, motherfucker, die" than "die Mutter". ( https://github.com/openai/gpt-3/blob/master/dataset_statisti... )
    comment by Trapais · 2023-06-18 · in No, GPT4 Can’t Ace MIT
  5. GPT-3 is opensource. GPT-4 isn't. https://github.com/openai/gpt-3
    comment by oldsecondhand · 2023-04-30 · in Just Simply – Stop saying how simple things are in our docs
  6. …taken up by french at 1.8%. Most of the languages GPT-3 knows are sitting at <0.2% representation. https://github.com/openai/gpt-3/blob/master/dataset_statisti... Competence in the main language will bleed into the rest.
    comment by og_kalu · 2023-04-13 · in BharatGPT: India's Own ChatGPT
  7. …many languages despite English taking up 93% of the corpus by word count. French is next with 1.8% https://github.com/openai/gpt-3/blob/master/dataset_statisti... Dunno the statistics of language presence with GPT-4 but it takes it up…
    comment by og_kalu · 2023-04-10 · in Why is GPT-3 15.77x more expensive for certain languages?
  8. 1.7k forks… https://github.com/openai/gpt-3 apart from that, several pre trained corpuses had been around for a while
    comment by bdhcuidbebe · 2023-02-04 · in Show HN: DocsGPT, open-source documentation assistant, fully aware of libraries
  9. …adulthood. How is the human brain able to achieve a higher level of success with 1% of the data? 1. https://github.com/openai/gpt-3/blob/master/dataset_statisti...
    comment by kelseyfrog · 2022-04-11 · in DeepMind’s New Language Model, Chinchilla
  10. …/openai/gpt-2/commit/c2dae27c1029770cea409... May 28 2020, timed alongside the press news for GPT-3 - https://github.com/openai/gpt-3/commit/12766ba31aa6de490226e... - Would it really have to be a conspiracy? Sounds like only one person…
    comment by eganist · 2022-04-06 · in Dall-E 2
  11. …that too - I also don't understand why should they be. [0] https://arxiv.org/abs/2005.14165 [1] https://github.com/openai/gpt-3
    comment by emteycz · 2020-10-07 · in AI training method exceeds GPT-3 performance with fewer parameters
  12. …the fine tuned models that everyone else use. Few-shot GPT3 outperforms a BERT-based baseline. [1] https://github.com/openai/gpt-3
    comment by nl · 2020-10-07 · in AI training method exceeds GPT-3 performance with fewer parameters
  13. …smaller models will perform. Looking forward to experimenting with those once they’re released! [0] https://github.com/openai/gpt-3/issues/1#issuecomment-636008...
    comment by peterthehacker · 2020-08-05 · in GPT-3 GH repo archived and Model release remains an open issue
  14. The vast majority (>93%) is English (by document): https://github.com/openai/gpt-3/blob/master/dataset_statisti...
    comment by supermatt · 2020-07-28 · in How GPT3 Works – Visualizations and Animations
  15. > For GPT-2, their repository is archived Fun fact: the GPT-3 repo ( https://github.com/openai/gpt-3 ) is archived too, but it does use the GitHub archive feature, unlike the GPT-2 repo.
    comment by Aissen · 2020-07-20 · in OpenAI should now change their name to ClosedAI
  16. …https://openai.com/blog/openai-api/ ) Recently, OpenAI set the GPT-3 GitHub repo to read-only: https://github.com/openai/gpt-3 Taken together, this seems to imply that GPT-3 was more intended for a SaaS such as this, and it's less likely…
    comment by minimaxir · 2020-06-11 · in OpenAI API
  17. Is there a fast.ai like library that allows a novice to try GPT-3? https://github.com/openai/gpt-3 only contains dataset
    comment by dhab · 2020-05-29 · in GPT-3: Language Models Are Few-Shot Learners
  18. …have not yet been released, and it looks like someone has already asked about it in the issues: https://github.com/openai/gpt-3/issues/1
    comment by ColanR · 2020-05-29 · in GPT-3: Language Models Are Few-Shot Learners