XuezheMax/megalodon
View on GitHub ↗ ★ 526 Cuda
Reference implementation of Megalodon 7B model
4 mentions on Hacker News by 4 people: 0 stories, 4 comments · first 2024-04-16 · latest 2024-06-11
20082026
-
Didn't this happen in April? Edit: Yes it did, https://github.com/XuezheMax/megalodon
comment by ai_what · 2024-06-11 · in Meta Open-Sources Megalodon LLM for Efficient Long Sequence Modeling -
repo link: https://github.com/XuezheMax/megalodon
comment by causalmodels · 2024-06-11 · in Meta Open-Sources Megalodon LLM for Efficient Long Sequence Modeling -
…from Meta. We had to re-organize a small part of the code. Now the repo has been re-opened at https://github.com/XuezheMax/megalodon The model checkpoint is still under Meta legal review. We will release it once we get approval.
comment by maxma1987 · 2024-04-17 · in Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length -
1. Open paper 2. Find GitHub 3. Read Source https://github.com/XuezheMax/megalodon Dead link I have stoped reading the papers, I only care about working code that can be used. Arvix LLM papers have reached the level of academic…
comment by zer00eyz · 2024-04-16 · in Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length