/home/preachermanx/.local/lib/python3.6/site-packages/torch/cuda/__init__.py:114: UserWarning:
Found GPU0 TITAN V which requires CUDA_VERSION >= 9000 for
optimal performance and fast startup time, but your PyTorch was compiled
with CUDA_VERSION 8000. Please install the correct PyTorch binary
using instructions from http://pytorch.org
warnings.warn(incorrect_binary_warn % (d, name, 9000, CUDA_VERSION))
I implicitly used the following for pytorch install.
This is the binary that work with CUDA 9.1, but do you have it installed? Also if you have an old CUDA 8.0 install, make sure that it won’t be loaded instead of the 9.1.
Your python shell is python 3.6 (from the place where it loads torch in the error message). While you install the package for python 3.5.
So I guess your python 3.6 has an older pytorch binary installed and you reinstall the one for 3.5 (from the wheel name)?
I put the wrong line in this thread, as I just scraped it off the install page without clicking the correct one.
I had actually installed only one pytorch on this box, and it is the correct one. This is does not appear to be a multiple install issue, or legacy install issue. This is a fresh box just built. Can anyone verify that this works on a Titan V or V100 with pytorch?
pip3 install http://download.pytorch.org/whl/cu91/torch-0.4.0-cp36-cp36m-linux_x86_64.whl
Requirement already satisfied: torch==0.4.0 from http://download.pytorch.org/whl/cu91/torch-0.4.0-cp36-cp36m-linux_x86_64.whl in ./.local/lib/python3.6/site-packages (0.4.0)
torch 0.4.0
torchvision 0.2.1
-rwxrwxr-x 1 preachermanx preachermanx 329281896 May 1 14:51 _C.cpython-36m-x86_64-linux-gnu.so
Found GPU0 Tesla V100-DGXS-16GB which requires CUDA_VERSION >= 9000 for
optimal performance and fast startup time, but your PyTorch was compiled
with CUDA_VERSION 8000. Please install the correct PyTorch binary
using instructions from http://pytorch.org
It appears there is some issue with the compiled version not playing nicely with the V100 architecture.
Temporary workaround I’m using is to downgrade to 0.3.1:
RUN pip3 install http://download.pytorch.org/whl/cu90/torch-0.3.1-cp35-cp35m-linux_x86_64.whl