Torch has a conflict with scipy?

Has anyone have any idea what is going on in the following case? I tested the following with a clean install of PyTorch 3.1 and Scipy 1.0.0 both with conda (Python 3.6.4; 01/16/2018; GCC 7.2.0) on linux.

(test) [userme@server folder]$ python
Python 3.6.4 |Anaconda, Inc.| (default, Jan 16 2018, 18:10:19)
[GCC 7.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import torch
>>> from scipy.stats import dirichlet
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/userme/envs/test/lib/python3.6/site-packages/scipy/stats/__init__.py", line 343, in <module>
    from .stats import *
  File "/home/userme/envs/test/lib/python3.6/site-packages/scipy/stats/stats.py", line 169, in <module>
    import scipy.special as special
  File "/home/userme/envs/test/lib/python3.6/site-packages/scipy/special/__init__.py", line 648, in <module>
    from ._ellip_harm import ellip_harm, ellip_harm_2, ellip_normal
  File "/home/userme/envs/test/lib/python3.6/site-packages/scipy/special/_ellip_harm.py", line 7, in <module>
    from ._ellip_harm_2 import _ellipsoid, _ellipsoid_norm
  File "_ellip_harm_2.pyx", line 7, in init scipy.special._ellip_harm_2
  File "/home/userme/envs/test/lib/python3.6/site-packages/scipy/integrate/__init__.py", line 93, in <module>
    from ._bvp import solve_bvp
  File "/home/userme/envs/test/lib/python3.6/site-packages/scipy/integrate/_bvp.py", line 9, in <module>
    from scipy.sparse import coo_matrix, csc_matrix
  File "/home/userme/envs/test/lib/python3.6/site-packages/scipy/sparse/__init__.py", line 229, in <module>
    from .csr import *
  File "/home/userme/envs/test/lib/python3.6/site-packages/scipy/sparse/csr.py", line 15, in <module>
    from ._sparsetools import csr_tocsc, csr_tobsr, csr_count_blocks, \
ImportError: /usr/local/anaconda3/lib/libstdc++.so.6: version 'CXXABI_1.3.9' not found (required by /home/userme/envs/test/lib/python3.6/site-packages/scipy/sparse/_sparsetools.cpython-36m-x86_64-linux-gnu.so)

(test) [userme@server folder]$ python
Python 3.6.4 |Anaconda, Inc.| (default, Jan 16 2018, 18:10:19)
[GCC 7.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from scipy.stats import dirichlet
>>> import torch
>>>

This gave me problems because I used torch.save to save some models that had scipy dirichlet objects in them. When I tried to load them, I did import torch first and the loading never worked. To bypass that I need to load scipy.stats.dirichlet first and then torch.