GLOO and infiniband

Can GLOO work with infiniband?

Our RTX2080ti GPUs do not support GPUDirect/RDMA anyway, so the only thing we want is to work out of the box in reasonable BW which will not become the bottleneck, we are doing P2P communication.

edit: well I see that here they say its supported, but I wonder if you still have anything further to say on integration with Pytorch.

edit2: especially since here its written than GLOO does not support infiniband.


GLOO does have an ibverbs transport However, it was never used or tested with PyTorch. That may be the reason that PyTorch doc says GLOO does not support infiniband.

We are about to test GLOO ibverbs transport over RDMA, and integrate with PyTorch on HPC scenarios. For now, GLOO ibverbs hasn’t been integrated to PyTorch yet.

Filed an issue