yandex/YaLM-100B
View on GitHub ↗ ★ 3,755 Python
Pretrained language model with 100B parameters
8 mentions on Hacker News by 8 people: 1 story, 7 comments · first 2022-06-23 · latest 2023-01-10
20082026
-
…incredible. The Yandex YaLM LLM model is 100B parameters but is unfortunately 75% in Russian (See https://github.com/yandex/YaLM-100B ). You can technically run it though on a big AWS instance. Someone needs to invent some good LLM…
comment by narrator · 2023-01-10 · in Microsoft eyes $10B bet on ChatGPT -
…beyond what I randomly happen to see on HN, but this might still be the largest open source model: https://github.com/yandex/YaLM-100B . There's discussion of it here: https://old.reddit.com/r/MachineLearning/comments/vpn0r1/d_h... - at…
comment by htns · 2022-12-29 · in Ask HN: Can I download GPT / ChatGPT to my desktop? -
…there's no need to embellish or exaggerate. [1] https://www.youtube.com/watch?v=YQ2QtKcK2dA [2] https://github.com/yandex/YaLM-100B [3] https://github.com/facebookresearch/metaseq
comment by benreesman · 2022-08-21 · in Beyond Hyperanthropomorphism -
Fortunately? Somebody already did the training for them! https://github.com/yandex/YaLM-100B
comment by ctoth · 2022-07-02 · in What's the deal with all those weird wrong-number texts? -
Direct link: https://github.com/yandex/YaLM-100B/blob/main/README.md#trai...
comment by remram · 2022-06-27 · in Meta is inviting researchers to pick apart the flaws in its version of GPT-3 -
…parts is deliberately not contiguous; the 03-82 range represents the main 80 transformer layers. https://github.com/yandex/YaLM-100B/blob/main/megatron_lm/me...
comment by hansonw · 2022-06-23 · in YaLM-100B: Pretrained language model with 100B parameters -
https://github.com/yandex/YaLM-100B/blob/main/LICENSE apache license >The model is published under the Apache 2.0 license that permits both research and commercial use you should be fine
comment by 2Gkashmiri · 2022-06-23 · in YaLM-100B: Pretrained language model with 100B parameters