alpa-projects/alpa
View on GitHub ↗ ★ 3,177 Python archived
Training and serving large-scale neural networks with auto parallelization.
3 mentions on Hacker News by 3 people: 1 story, 2 comments · first 2022-06-23 · latest 2023-03-22
20082026
-
…ub.com/oobabooga/text-generation-webui/issues/14... - https://github.com/bigscience-workshop/petals - https://github.com/alpa-projects/alpa
comment by lxe · 2023-03-22 · in Show HN: Finetune LLaMA-7B on commodity GPUs using your own text -
…examples of LLM projects using Ray! - Alpa does training and serving with 175B parameter models https://github.com/alpa-projects/alpa - GPT-J https://github.com/kingoflolz/mesh-transformer-jax - Another HN thread on training LLMs with Ray…
comment by robertnishihara · 2023-02-12 · in How to train large models on many GPUs? (2021)