Hacker GitHub

← All repos

young-geng/EasyLM

View on GitHub ↗ ★ 2,517 Python

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

4 mentions on Hacker News by 4 people: 0 stories, 4 comments · first 2023-04-05 · latest 2024-04-24

Mentions per year 4 mentions · busiest year 2023 (3)
20082026
  1. …people's thoughts on how this compares to: - EasyLM [1] - Levanter [2] - T5X [3] - and more? [1]: https://github.com/young-geng/EasyLM [2]: https://github.com/stanford-crfm/levanter [3]: https://github.com/google-research/t5x Asking…
  2. …from https://huggingface.co/openlm-research/open_llama_7b_preview... 3. Install Anaconda. Clone https://github.com/young-geng/EasyLM/ . 4. Install EasyLM: conda env create -f scripts/gpu_environment.yml conda activate EasyLM 5. Run this…
    comment by quickthrower2 · 2023-05-03 · in OpenLLaMA: An Open Reproduction of LLaMA
  3. …language finetunes is bound to get better rapidly. EDIT: And there is also this for JAX finetuning. https://github.com/young-geng/EasyLM/blob/main/docs/llama.md
  4. …from the distributed accelerators to the main memory at a time, hence saving a lot of memory. https://github.com/young-geng/EasyLM/blob/main/docs/checkpoi... https://github.com/young-geng/EasyLM/blob/main/docs/koala.md Presumably the same…