google-deepmind/recurrentgemma
View on GitHub ↗ ★ 686 Python
Open weights language model from Google DeepMind, based on Griffin.
4 mentions on Hacker News by 4 people: 2 stories, 2 comments · first 2024-04-09 · latest 2024-04-22
20082026
-
Blog post: https://developers.googleblog.com/2024/04/gemma-family-expan... Github: https://github.com/google-deepmind/recurrentgemma HuggingFace: https://huggingface.co/google/recurrentgemma-2b
comment by bcherny · 2024-04-22 · in RecurrentGemma: Moving Past Transformers for Efficient Open Language Models -
▲ 218
Implementation of Google's Griffin Architecture – RNN LLMstory by milliondreams · 2024-04-10 · 38 comments
-
Code here: https://github.com/google-deepmind/recurrentgemma Checkpoints here for both base pre-trained model and an IT version for dialogue: https://www.kaggle.com/models/google/recurrentgemma
comment by aaboltaabol · 2024-04-10 · in RecurrentGemma: Moving Past Transformers for Efficient Open Language Models [pdf] -
▲ 3
RecurrentGemma: Mixture local attention and linear recurrencesstory by tosh · 2024-04-09 · 0 comments