I get the above mentioned error when I try to run the followed code:
import torch.distributed import ipdb
if name == ‘main’: ipdb.set_trace() torch.distributed.init_process_group(backend=‘mpi’) rank = torch.distributed.collectives.get_rank()
print('My rank is ' + rank)
I am running this code on command line as follows: mpiexec -n 2 python main.py
torch.distributed is still alpha quality and you can expect weird broken builds.
we will announce when it’s ready.
Thank you for your reply.
Does it mean that I should update my installed package to get a working version? Or the package torch.distributed is not functional yet in which case I will wait for your announcement.