Hacker GitHub

← All repos

facebookresearch/lingua

View on GitHub ↗ ★ 4,774 Python

Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.

4 mentions on Hacker News by 2 people: 1 story, 3 comments · first 2024-10-18 · latest 2025-08-09

Mentions per year 4 mentions · busiest year 2024 (2)
20082026
AllStoriesComments NewestTopOldest
  1. …increased more so the n^2 part is non negligible. See the repo for correct flop calculation[1] [1]: https://github.com/facebookresearch/lingua/blob/437d680e5218...
    comment by YetAnotherNick · 2025-08-09 · in GPU-rich labs have won: What's left for the rest of us is distillation
  2. …MFU is around 45% for H100 for large enough models[2]. [1]: https://arxiv.org/abs/2001.08361 [2]: https://github.com/facebookresearch/lingua
    comment by YetAnotherNick · 2025-08-08 · in GPU-rich labs have won: What's left for the rest of us is distillation
  3. …repo[2] by Meta achieves 48% MFU, or 80k token/second. [1]: https://arxiv.org/pdf/2001.08361 [2]: https://github.com/facebookresearch/lingua
    comment by YetAnotherNick · 2024-11-02 · in AMD Open-Source 1B OLMo Language Models
  4. ▲ 1
    Meta Lingua: Lean, efficient, and easy-to-hack codebase to research LLMs
    story by zerojames · 2024-10-18 · 0 comments