huggingface/accelerate
View on GitHub ↗ ★ 9,940 Python
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
3 mentions on Hacker News by 2 people: 0 stories, 3 comments · first 2022-07-13 · latest 2024-10-07
20082026
-
Note that this blog post was made last month but the official stable launch just happened: https://github.com/huggingface/accelerate/releases/tag/v1.0....
comment by minimaxir · 2024-10-07 · in HuggingFace Accelerate 1.0.0 -
…I believe the BFloat16 support is pretty recent (22 days ago) and may not be in conda/pip: https://github.com/huggingface/accelerate/commit/f13c59f91e2...
comment by moyix · 2022-07-14 · in BLOOM: The largest open multilingual language model -
…be preloaded in parallel as other layers are executing inference, which should make things faster: https://github.com/huggingface/accelerate/issues/512#issueco...
comment by moyix · 2022-07-13 · in BLOOM: The largest open multilingual language model