Pytorch with Horovod

I am trying to use Pytorch with Horovod. I am trying to run one of the example. I am getting the following error:

Traceback (most recent call last):
  File "", line 3, in <module>
    import torch
  File "/ccs/home/amalik/.conda/envs/py366/lib/python3.6/site-packages/torch/", line 84, in <module>
    from torch._C import *
ImportError: /ccs/home/amalik/.conda/envs/py366/lib/python3.6/site-packages/torch/lib/ undefined symbol: MPIX_Query_cuda_support

However, when I import torch on simple python command, I don’t get the error.

a>> python
>>> import torch

no error message