EleutherAI/pythia
View on GitHub ↗ ★ 2,987 Jupyter Notebook
The hub for EleutherAI's work on interpretability and learning dynamics
4 mentions on Hacker News by 4 people: 1 story, 3 comments · first 2023-04-05 · latest 2024-01-18
20082026
-
…of LLMs This skepticism seems reasonable. EleutherAI have documentation to reproduce training ( https://github.com/EleutherAI/pythia#reproducing-training ). So far I haven't seen it leading to anything. Lots of arxiv papers I've seen…
comment by Trapais · 2024-01-18 · in If you can't reproduce the model then it's not open-source -
The ones I saw mentioned so far were Flan, Cerebras, GPT-J, and RWKV. Not yet mentioned: * Pythia https://github.com/EleutherAI/pythia * GLM-130B https://github.com/THUDM/GLM-130B - see also ChatGLM-6B https://github.com/THUDM/ChatGLM-6B *…
comment by lhl · 2023-04-10 · in Ask HN: Open source LLM for commercial use? -
Is this the link? https://engineering.fb.com/2019/05/21/ai-research/pythia/ or maybe this? https://github.com/EleutherAI/pythia I'm confused.
comment by ALLTaken · 2023-04-05 · in Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling