XueFuzhao/OpenMoE
View on GitHub ↗ ★ 1,704 Python
A family of open-sourced Mixture-of-Experts (MoE) Large Language Models
6 mentions on Hacker News by 4 people: 1 story, 5 comments · first 2023-08-21 · latest 2023-11-26
20082026
-
What about this one? https://github.com/XueFuzhao/OpenMoE
comment by ilaksh · 2023-11-26 · in Ask HN: Why is GPT4 better than the other major LLMs? -
https://github.com/XueFuzhao/OpenMoE Check out this open source Mixture of Experts research. Could help a lot with performance of open source models.
comment by ilaksh · 2023-11-08 · in Major outages across ChatGPT and API -
…true right now but in X months it may be totally outdated advice. For example, efforts like OpenMOE https://github.com/XueFuzhao/OpenMoE or similar will probably eventually lead to very competitive performance and cost-effectiveness for…
comment by ilaksh · 2023-10-12 · in OpenAI is too cheap to beat -
…8 billion parameters. [1] [0] https://github.com/google-research/t5x/blob/main/docs/models... [1] https://github.com/XueFuzhao/OpenMoE
comment by javidlakha · 2023-10-09 · in Mixtures of Experts -
…a number of open source projects working on just such a model right now. Here's a great example: https://github.com/XueFuzhao/OpenMoE/
comment by jph00 · 2023-09-24 · in A hacker's guide to language models [video] -
▲ 3
OpenMoE – A family of open-sourced Mixture-of-Experts (MoE) LLMsstory by tim_sw · 2023-08-21 · 0 comments