pytorch/gloo
View on GitHub ↗ ★ 1,465 C++
Collective communications library with various primitives for multi-machine training.
3 mentions on Hacker News by 3 people: 0 stories, 3 comments · first 2017-06-13 · latest 2024-06-13
20082026
-
Random q, I wonder if gloo is used in these systems? https://github.com/facebookincubator/gloo RDMA and GPUDirect capable. Coordinates over MPI or (hi)redia.
comment by jauntywundrkind · 2024-06-13 · in How Meta trains large language models at scale -
PyTorch itself isnt, But the multi-GPU version requires Gloo which is BSD+PATENTS https://github.com/facebookincubator/gloo/blob/master/PATENT...
comment by aub3bhat · 2017-09-23 · in Relicensing React, Jest, Flow, and Immutable.js -
…phase where all nodes connect to their peers. Using Redis for this is one of the options. See: https://github.com/facebookincubator/gloo/tree/master/gloo/r...
comment by pietern · 2017-06-13 · in Facebook Trains ImageNet in 1 Hour