young-geng/EasyLM
View on GitHub ↗ ★ 2,517 Python
Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
4 mentions on Hacker News by 4 people: 0 stories, 4 comments · first 2023-04-05 · latest 2024-04-24
20082026
-
…people's thoughts on how this compares to: - EasyLM [1] - Levanter [2] - T5X [3] - and more? [1]: https://github.com/young-geng/EasyLM [2]: https://github.com/stanford-crfm/levanter [3]: https://github.com/google-research/t5x Asking…
comment by arjvik · 2024-04-24 · in Maxtext: A simple, performant and scalable Jax LLM -
…from https://huggingface.co/openlm-research/open_llama_7b_preview... 3. Install Anaconda. Clone https://github.com/young-geng/EasyLM/ . 4. Install EasyLM: conda env create -f scripts/gpu_environment.yml conda activate EasyLM 5. Run this…
comment by quickthrower2 · 2023-05-03 · in OpenLLaMA: An Open Reproduction of LLaMA -
…language finetunes is bound to get better rapidly. EDIT: And there is also this for JAX finetuning. https://github.com/young-geng/EasyLM/blob/main/docs/llama.md
comment by brucethemoose2 · 2023-04-23 · in Godot-dodo – Finetuning LLaMA on single-language comment:code data pairs -
…from the distributed accelerators to the main memory at a time, hence saving a lot of memory. https://github.com/young-geng/EasyLM/blob/main/docs/checkpoi... https://github.com/young-geng/EasyLM/blob/main/docs/koala.md Presumably the same…
comment by andai · 2023-04-05 · in State-of-the-art open-source chatbot, Vicuna-13B, just released model weights