Hello everyone i am new to the community, Is there any way to build NCCL in windows to get the power of NCCL for multi-GPU training??
No, since NCCL does not support Windows. Use Gloo for distributed operations on Windows.
1 Like
in the above link there is build of nccl for windows given by MyCaffe, will it work if i build nccl from this and use it my code for PyTorch.
Please Help if you can
As already explained, NCCL on Windows is not supported and I don’t know if this fork will work. You could of course try it out or just use Gloo.
Okay Thanks for the help