Pytorch with Horovod

I am trying to use Pytorch with Horovod. I am trying to run one of the example. I am getting the following error:

Traceback (most recent call last):
  File "pytorch_imagenet_resnet50.py", line 3, in <module>
    import torch
  File "/ccs/home/amalik/.conda/envs/py366/lib/python3.6/site-packages/torch/__init__.py", line 84, in <module>
    from torch._C import *
ImportError: /ccs/home/amalik/.conda/envs/py366/lib/python3.6/site-packages/torch/lib/libtorch_python.so: undefined symbol: MPIX_Query_cuda_support

However, when I import torch on simple python command, I don’t get the error.

a>> python
>>> import torch
>>>

no error message