google-research/t5x
View on GitHub ↗ ★ 3,006 Python
5 mentions on Hacker News by 5 people: 0 stories, 5 comments · first 2023-10-09 · latest 2026-08-10
20082026
-
…moment. https://github.com/EleutherAI/gpt-neo/releases https://github.com/google-research/bert https://github.com/google-research/t5x If you're learning about AI models it's still worthwhile to review these models and codebases because…
comment by canyon289 · 2026-08-10 · in Mark Zuckerberg attacks 'closed' AI rivals as Meta returns to open models -
…more? [1]: https://github.com/young-geng/EasyLM [2]: https://github.com/stanford-crfm/levanter [3]: https://github.com/google-research/t5x Asking because I have worked extensively on training a large model on a TPU cluster, and started…
comment by arjvik · 2024-04-24 · in Maxtext: A simple, performant and scalable Jax LLM -
…document text may not work, haven't tried that. Google has a good example of training scripts here: https://github.com/google-research/t5x (under training. and then finetuning). I like this one. Facebook Research also has a few on their…
comment by ankit219 · 2023-12-11 · in Mixtral of experts -
…3 years ago [2]. IMO "releases" means that it was released recently, but that's not the case. [1] https://github.com/google-research/t5x/commit/199f226eeff5f8... [2] https://arxiv.org/abs/2101.03961
comment by Tiberium · 2023-11-20 · in Switch Transformers C – 2048 experts (1.6T params for 3.1 TB) (2022) -
…a mixture of experts model. Currently they've released a model with 8 billion parameters. [1] [0] https://github.com/google-research/t5x/blob/main/docs/models... [1] https://github.com/XueFuzhao/OpenMoE
comment by javidlakha · 2023-10-09 · in Mixtures of Experts