Can't compile PyTorch 0.4.1 with CUDA support on Linux; commands not found

piojanu · September 19, 2018, 6:04pm

Hi!

I have following problem during PyTorch compilation on Linux (I’ve been able to successfully compile it on macOS):

Install the project...
-- Install configuration: "Release"
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/share/cmake/Gloo/GlooConfig.cmake
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/share/cmake/Gloo/GlooConfigVersion.cmake
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/share/cmake/Gloo/GlooTargets.cmake
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/share/cmake/Gloo/GlooTargets-release.cmake
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/lib/libgloo.a
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/lib/libgloo_builder.a
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/lib/libgloo_cuda.a
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/config.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/algorithm.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/allgather_ring.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/allreduce_halving_doubling.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/allreduce_bcube.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/allreduce_local.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/allreduce_ring.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/allreduce_ring_chunked.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/barrier.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/barrier_all_to_all.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/barrier_all_to_one.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/broadcast_one_to_all.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/reduce_scatter.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/context.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/math.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/pairwise_exchange.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/types.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/common/common.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/common/error.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/common/linux.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/common/linux_devices.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/common/logging.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/common/string.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/rendezvous/file_store.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/rendezvous/hash_store.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/rendezvous/prefix_store.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/rendezvous/store.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/rendezvous/context.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/transport/address.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/transport/buffer.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/transport/device.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/transport/pair.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/transport/tcp/address.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/transport/tcp/buffer.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/transport/tcp/device.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/transport/tcp/pair.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/allreduce_builder.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/broadcast_builder.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/cuda.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/cuda_allreduce_halving_doubling.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/cuda_allreduce_halving_doubling_pipelined.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/cuda_allreduce_local.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/cuda_allreduce_ring.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/cuda_allreduce_ring_chunked.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/cuda_broadcast_one_to_all.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/cuda_collectives_device.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/cuda_collectives_host.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/cuda_collectives_native.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/cuda_collectives_nccl.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/cuda_private.h
-- Installing: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/gloo/cuda_workspace.h
+ popd
~/Programs/pytorch/third_party ~/Programs/pytorch
++ uname
+ [[ Linux == \D\a\r\w\i\n ]]
+ popd
~/Programs/pytorch
+ for arg in '"$@"'
+ [[ THD == \n\c\c\l ]]
+ [[ THD == \g\l\o\o ]]
+ [[ THD == \c\a\f\f\e\2 ]]
+ [[ THD == \T\H\D ]]
+ pushd /macierz/home/155079jp/Programs/pytorch/torch/lib
~/Programs/pytorch/torch/lib ~/Programs/pytorch
+ build THD
+ mkdir -p build/THD
+ pushd build/THD
~/Programs/pytorch/torch/lib/build/THD ~/Programs/pytorch/torch/lib ~/Programs/pytorch
+ BUILD_C_FLAGS=
+ case $1 in
+ BUILD_C_FLAGS=' -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include"   -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/TH" -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/THC"   -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/THS" -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/THCS"   -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/THNN" -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/THCUNN" -DOMPI_SKIP_MPICXX=1 -fexceptions'
+ cmake ../../THD -DCMAKE_MODULE_PATH=/macierz/home/155079jp/Programs/pytorch/cmake/Modules_CUDA_fix -DTorch_FOUND=1 -DCMAKE_INSTALL_PREFIX=/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install '-DCMAKE_C_FLAGS= -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include"   -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/TH" -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/THC"   -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/THS" -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/THCS"   -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/THNN" -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/THCUNN" -DOMPI_SKIP_MPICXX=1 -fexceptions ' '-DCMAKE_CXX_FLAGS= -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include"   -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/TH" -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/THC"   -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/THS" -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/THCS"   -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/THNN" -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/THCUNN" -DOMPI_SKIP_MPICXX=1 -fexceptions  -std=c++11  ' '-DCMAKE_EXE_LINKER_FLAGS=-L"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/lib"  -Wl,-rpath,$ORIGIN ' '-DCMAKE_SHARED_LINKER_FLAGS=-L"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/lib"  -Wl,-rpath,$ORIGIN ' -DCMAKE_INSTALL_LIBDIR=/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/lib '-DCUDA_NVCC_FLAGS= -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include"   -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/TH" -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/THC"   -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/THS" -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/THCS"   -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/THNN" -I"/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/THCUNN" -DOMPI_SKIP_MPICXX=1' -DCUDA_DEVICE_DEBUG=0 -DCMAKE_PREFIX_PATH=/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install '-Dcwrap_files=/macierz/home/155079jp/Programs/pytorch/torch/lib/ATen/Declarations.cwrap;/macierz/home/155079jp/Programs/pytorch/torch/lib/THNN/generic/THNN.h;/macierz/home/155079jp/Programs/pytorch/torch/lib/THCUNN/generic/THCUNN.h;/macierz/home/155079jp/Programs/pytorch/torch/lib/ATen/nn.yaml' -DTH_INCLUDE_PATH=/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include -DTH_LIB_PATH=/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/lib -DTH_LIBRARIES=/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/lib/libTH.so -DCAFFE2_LIBRARIES=/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/lib/libcaffe2.so -DTHNN_LIBRARIES=/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/lib/libTHNN.so -DTHCUNN_LIBRARIES=/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/lib/libTHCUNN.so -DTHS_LIBRARIES=/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/lib/libTHS.so -DTHC_LIBRARIES=/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/lib/libTHC.so -DTHCS_LIBRARIES=/macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/lib/libTHCS.so -DTH_SO_VERSION=1 -DTHC_SO_VERSION=1 -DTHNN_SO_VERSION=1 -DTHCUNN_SO_VERSION=1 -DTHD_SO_VERSION=1 -DUSE_CUDA=1 -DNO_NNPACK=0 -DNCCL_EXTERNAL=1 -Dnanopb_BUILD_GENERATOR=0 -DCMAKE_DEBUG_POSTFIX= -DCMAKE_BUILD_TYPE=Release -DCMAKE_EXPORT_COMPILE_COMMANDS=1
-- The C compiler identification is GNU 4.8.5
-- The CXX compiler identification is GNU 4.8.5
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Performing Test HAS_THREAD_LOCAL
-- Performing Test HAS_THREAD_LOCAL - Success
-- Found MPI_C: /usr/lib64/mpi/gcc/mvapich2/lib64/libmpi.so (found version "3.0") 
-- Found MPI_CXX: /usr/lib64/mpi/gcc/mvapich2/lib64/libmpicxx.so (found version "3.0") 
-- Found MPI: TRUE (found version "3.0")  
-- Found Gloo: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include  
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Looking for pthread_create
-- Looking for pthread_create - not found
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE  
-- Caffe2: Found protobuf with new-style protobuf targets.
-- Caffe2: Protobuf version 3.5.0
-- Found CUDA: /usr/local/cuda (found suitable version "9.1", minimum required is "7.0") 
-- Caffe2: CUDA detected: 9.1
-- Caffe2: CUDA nvcc is: /usr/local/cuda/bin/nvcc
-- Caffe2: CUDA toolkit directory: /usr/local/cuda
-- Caffe2: Header version is: 9.1
-- Found CUDNN: /usr/local/cuda/include  
-- Found cuDNN: v7.0.5  (include: /usr/local/cuda/include, library: /usr/local/cuda/lib64/libcudnn.so.7)
-- Autodetected CUDA architecture(s): 6.1 
-- Added CUDA NVCC flags for: -gencode;arch=compute_61,code=sm_61
-- Found CUDA: /usr/local/cuda (found suitable version "9.1", minimum required is "7.5") 
-- Found NCCL: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include  
-- Determining NCCL version from the header file: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include/nccl.h
-- Found NCCL (include: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/include, library: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/lib/libnccl.so)
-- MPI_LIBRARIES: /usr/lib64/mpi/gcc/mvapich2/lib64/libmpicxx.so;/usr/lib64/mpi/gcc/mvapich2/lib64/libmpi.so
-- Found Gloo, will compile with Gloo distributed backend
-- Building the gloo backend with TCP support only
-- NCCL_LIBRARIES: /macierz/home/155079jp/Programs/pytorch/torch/lib/tmp_install/lib/libnccl.so
-- Found NCCL, but the NCCL version is either not 2+ or not determinable, will not compile with NCCL distributed backend
-- Excluding /macierz/home/155079jp/Programs/pytorch/torch/lib/THD/master_worker/worker/dispatch/Communication.cpp from the build
-- Excluding /macierz/home/155079jp/Programs/pytorch/torch/lib/THD/master_worker/worker/dispatch/Generator.cpp from the build
-- Excluding /macierz/home/155079jp/Programs/pytorch/torch/lib/THD/master_worker/worker/dispatch/Storage.cpp from the build
-- Excluding /macierz/home/155079jp/Programs/pytorch/torch/lib/THD/master_worker/worker/dispatch/Tensor.cpp from the build
-- Excluding /macierz/home/155079jp/Programs/pytorch/torch/lib/THD/master_worker/worker/dispatch/TensorCopy.cpp from the build
-- Excluding /macierz/home/155079jp/Programs/pytorch/torch/lib/THD/master_worker/worker/dispatch/TensorLapack.cpp from the build
-- Excluding /macierz/home/155079jp/Programs/pytorch/torch/lib/THD/master_worker/worker/dispatch/TensorMath.cpp from the build
-- Excluding /macierz/home/155079jp/Programs/pytorch/torch/lib/THD/master_worker/worker/dispatch/TensorRandom.cpp from the build
-- MPI_COMPILE_FLAGS: -fmessage-length=0;-funwind-tables;-fasynchronous-unwind-tables;-fstack-clash-protection
-- MPI_LINK_FLAGS: -Wl,-rpath -Wl,/usr/lib64/mpi/gcc/mvapich2/lib64 -Wl,--enable-new-dtags
-- Configuring done
-- Generating done
CMake Warning:
  Manually-specified variables were not used by the project:

    CMAKE_DEBUG_POSTFIX
    CMAKE_INSTALL_LIBDIR
    NCCL_EXTERNAL
    NO_NNPACK
    THCS_LIBRARIES
    THCUNN_LIBRARIES
    THCUNN_SO_VERSION
    THC_LIBRARIES
    THC_SO_VERSION
    THD_SO_VERSION
    THNN_LIBRARIES
    THNN_SO_VERSION
    THS_LIBRARIES
    TH_INCLUDE_PATH
    TH_LIBRARIES
    TH_LIB_PATH
    TH_SO_VERSION
    Torch_FOUND
    cwrap_files
    nanopb_BUILD_GENERATOR


-- Build files have been written to: /macierz/home/155079jp/Programs/pytorch/torch/lib/build/THD
+ make install -j8
Scanning dependencies of target THD
[  5%] Building CXX object CMakeFiles/THD.dir/base/ChannelUtils.cpp.o
c++: fatal error: no input files
compilation terminated.
/bin/sh: -funwind-tables: nie znaleziono polecenia
/bin/sh: -fasynchronous-unwind-tables: nie znaleziono polecenia
[ 11%] Building CXX object CMakeFiles/THD.dir/base/Cuda.cpp.o
/bin/sh: -fstack-clash-protection: nie znaleziono polecenia
CMakeFiles/THD.dir/build.make:62: polecenia dla obiektu 'CMakeFiles/THD.dir/base/ChannelUtils.cpp.o' nie powiodły się
make[2]: *** [CMakeFiles/THD.dir/base/ChannelUtils.cpp.o] Błąd 127
make[2]: *** Oczekiwanie na niezakończone zadania....
c++: fatal error: no input files
compilation terminated.
/bin/sh: -funwind-tables: nie znaleziono polecenia
[ 35%] Building CXX object CMakeFiles/THD.dir/base/RPCType.cpp.o
[ 35%] Building CXX object CMakeFiles/THD.dir/base/DataChannel.cpp.o
[ 35%] Building CXX object CMakeFiles/THD.dir/base/DataChannelRequest.cpp.o
/bin/sh: -fasynchronous-unwind-tables: nie znaleziono polecenia
/bin/sh: -fstack-clash-protection: nie znaleziono polecenia
CMakeFiles/THD.dir/build.make:75: polecenia dla obiektu 'CMakeFiles/THD.dir/base/Cuda.cpp.o' nie powiodły się
make[2]: *** [CMakeFiles/THD.dir/base/Cuda.cpp.o] Błąd 127
[ 47%] Building CXX object CMakeFiles/THD.dir/base/data_channels/DataChannelGloo.cpp.o
[ 47%] Building CXX object CMakeFiles/THD.dir/base/data_channels/DataChannelMPI.cpp.o
[ 47%] Building CXX object CMakeFiles/THD.dir/base/data_channels/DataChannelTCP.cpp.o
c++: fatal error: no input files
c++: fatal error: no input files
compilation terminated.
compilation terminated.
c++: fatal error: no input files
compilation terminated.
/bin/sh: -funwind-tables: nie znaleziono polecenia
/bin/sh: -funwind-tables: nie znaleziono polecenia
/bin/sh: -funwind-tables: nie znaleziono polecenia
/bin/sh: -fasynchronous-unwind-tables: nie znaleziono polecenia
/bin/sh: -fasynchronous-unwind-tables: nie znaleziono polecenia
/bin/sh: -fasynchronous-unwind-tables: nie znaleziono polecenia
/bin/sh: -fstack-clash-protection: nie znaleziono polecenia
/bin/sh: -fstack-clash-protection: nie znaleziono polecenia
c++: fatal error: no input files
CMakeFiles/THD.dir/build.make:114: polecenia dla obiektu 'CMakeFiles/THD.dir/base/RPCType.cpp.o' nie powiodły się
make[2]: *** [CMakeFiles/THD.dir/base/RPCType.cpp.o] Błąd 127
compilation terminated.
CMakeFiles/THD.dir/build.make:101: polecenia dla obiektu 'CMakeFiles/THD.dir/base/DataChannelRequest.cpp.o' nie powiodły się
make[2]: *** [CMakeFiles/THD.dir/base/DataChannelRequest.cpp.o] Błąd 127
c++: fatal error: no input files
compilation terminated.
/bin/sh: -fstack-clash-protection: nie znaleziono polecenia
CMakeFiles/THD.dir/build.make:88: polecenia dla obiektu 'CMakeFiles/THD.dir/base/DataChannel.cpp.o' nie powiodły się
make[2]: *** [CMakeFiles/THD.dir/base/DataChannel.cpp.o] Błąd 127
c++: fatal error: no input files
compilation terminated.
/bin/sh: -funwind-tables: nie znaleziono polecenia
/bin/sh: -funwind-tables: nie znaleziono polecenia
/bin/sh: -fasynchronous-unwind-tables: nie znaleziono polecenia
/bin/sh: -funwind-tables: nie znaleziono polecenia
/bin/sh: -fasynchronous-unwind-tables: nie znaleziono polecenia
/bin/sh: -fstack-clash-protection: nie znaleziono polecenia
/bin/sh: -fasynchronous-unwind-tables: nie znaleziono polecenia
/bin/sh: -fstack-clash-protection: nie znaleziono polecenia
CMakeFiles/THD.dir/build.make:127: polecenia dla obiektu 'CMakeFiles/THD.dir/base/data_channels/DataChannelGloo.cpp.o' nie powiodły się
make[2]: *** [CMakeFiles/THD.dir/base/data_channels/DataChannelGloo.cpp.o] Błąd 127
CMakeFiles/THD.dir/build.make:140: polecenia dla obiektu 'CMakeFiles/THD.dir/base/data_channels/DataChannelMPI.cpp.o' nie powiodły się
make[2]: *** [CMakeFiles/THD.dir/base/data_channels/DataChannelMPI.cpp.o] Błąd 127
/bin/sh: -fstack-clash-protection: nie znaleziono polecenia
CMakeFiles/THD.dir/build.make:153: polecenia dla obiektu 'CMakeFiles/THD.dir/base/data_channels/DataChannelTCP.cpp.o' nie powiodły się
make[2]: *** [CMakeFiles/THD.dir/base/data_channels/DataChannelTCP.cpp.o] Błąd 127
CMakeFiles/Makefile2:67: polecenia dla obiektu 'CMakeFiles/THD.dir/all' nie powiodły się
make[1]: *** [CMakeFiles/THD.dir/all] Błąd 2
Makefile:129: polecenia dla obiektu 'all' nie powiodły się
make: *** [all] Błąd 2
Failed to run 'bash tools/build_pytorch_libs.sh --use-cuda --use-nnpack --use-mkldnn nccl caffe2 nanopb libshm gloo THD c10d'

Sorry for polish language, it’s uni PC, I can’t change that (or can I? Do you know how?). I can translate if you don’t understand something.

Versions:
OS: openSUSE Leap 42.3
GCC: 4.8.5
conda: 4.5.11
Python: 3.6.5
CUDA: 9.1
cuDNN: 7.0
I work on NFS drive if it changes anything.

I’ve executed those commands before installation:

export CMAKE_PREFIX_PATH="$(dirname $(which conda))/../"
conda install numpy pyyaml mkl mkl-include setuptools cmake cffi typing
conda install -c mingfeima mkldnn
conda install -c pytorch magma-cuda91

I’ve changed magma-cuda80 to magma-cuda91.

I was looking through the Internet and couldn’t find any help. Do someone know what is going on?
Thanks for any help!

albanD · September 20, 2018, 9:17am

Hi,

It does look weird indeed.
It looks like it splits the compilation command line in the middle and so the compiler does not have input files specified, and it tries to execute the compiler arguments as bash methods.

Do you by any change used a windows computer to get the code before putting it on the machine where you compile?
Will you need the distributed package? If not, try compiling with NO_DISTRIBUTED=1 as MPI might be the problem here.
If that does not help, could you run make in verbose mode directly within /macierz/home/155079jp/Programs/pytorch/torch/lib/build/THD to see what is the exact command that it tries to execute please? That would help us fix this problem.

piojanu · September 21, 2018, 9:16am

Do you by any change used a windows computer to get the code before putting it on the machine where you compile?

Nope.

Will you need the distributed package? If not, try compiling with NO_DISTRIBUTED=1 as MPI might be the problem here.

Yea, I don’t think I’ll be trying to distribute training anytime soon. I set this variable and it compiled and installed fine this time. Tanks a lot for help!