PyTorch+Windows: is parallelization over multiple GPUs now possible?


I am planning to add a new GPU on my computer. Using Pytorch on Windows, I wonder if it will be possible for me to use parallelism.

In 2017 it wasn’t possible(
Has it changed? Will I have to switch to Linux? And is there a guide of how to install Pytorch for DataParallelism?

Thank you for all the library!

Hi, I am not aware of a NCCL binary from nvidia that supports windows, so parallelization over multiple GPUs on windows is still not possible.

Thank you very much for the answer. Is nccl installed automatically when installing CUDA on Linux, or do I need to add something else?