How to install pytorch with mpi-gpu support?

[Naruto-Sasuke]

We are suffering from this problem these days. Any tutorials about how to handle the problem?

[smth]

for MPI support, you have to install from source: https://github.com/pytorch/pytorch#from-source

[theevann (Evann)]

You may want some more infos here:

Segfault using cuda with openmpi

Hi there ! I am following the tutorial for writing distributed applications. Here is the basic example code. Everything works well as long as I don’t try using cuda. Is there a specific step to enable it that I missed ? I am getting a segfault… It might also be linked with some kind of permission issue since the signal code is “Invalid Permissions”. Any help would be really appreciated ! import os import torch import torch.distributed as dist import platform def run(rank, size): tens…