Hi,
I followed instructions at here.
- install dependencies
conda install numpy ninja pyyaml mkl mkl-include setuptools cmake cffi - clone pytorch
git clone --recursive GitHub - pytorch/pytorch: Tensors and Dynamic neural networks in Python with strong GPU acceleration
cd pytorch
// if you are updating an existing checkout
git submodule sync
git submodule update --init --recursive - export CMAKE_PREFIX_PATH=${CONDA_PREFIX:-“$(dirname $(which conda))/…/”}
python setup.py install
The output:
[1/1647] Generating libmkldnn.a
[2/1647] Building CXX object c10/CMakeFiles/c10.dir/util/numa.cpp.o
FAILED: c10/CMakeFiles/c10.dir/util/numa.cpp.o
/cluster/software/Anaconda3/2019.03/bin/c++ -DHAVE_MALLOC_USABLE_SIZE=1 -DHAVE_MMAP=1 -DHAVE_SHM_OPEN=1 -DHAVE_SHM_UNLINK=1 -DMINIZ_DISABLE_ZIP_READER_CRC32_CHECKS -DONNXIFI_ENABLE_EXT=1 -DONNX_ML=1 -DONNX_NAMESPACE=onnx_torch -DSUPPORTS_BACKTRACE=1 -D_FILE_OFFSET_BITS=64 -Dc10_EXPORTS -Iaten/src -I…/aten/src -I. -I…/ -I…/cmake/…/third_party/benchmark/include -Icaffe2/contrib/aten -I…/third_party/onnx -Ithird_party/onnx -I…/third_party/foxi -Ithird_party/foxi -I…/c10/… -isystem third_party/gloo -isystem …/cmake/…/third_party/gloo -isystem …/cmake/…/third_party/googletest/googlemock/include -isystem …/cmake/…/third_party/googletest/googletest/include -isystem …/third_party/protobuf/src -isystem …/third_party/gemmlowp -isystem …/third_party/neon2sse -isystem …/third_party/XNNPACK/include -isystem …/third_party -isystem …/cmake/…/third_party/eigen -isystem /cluster/software/Python/3.6.6-foss-2018b/include/python3.6m -isystem /cluster/home/cnphuong/my_environment/lib/python3.6/site-packages/numpy/core/include -isystem …/cmake/…/third_party/pybind11/include -isystem /opt/rocm/hip/include -isystem /include -isystem …/third_party/ideep/mkl-dnn/include -isystem …/third_party/ideep/include -Wno-deprecated -fvisibility-inlines-hidden -fopenmp -DNDEBUG -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DUSE_INTERNAL_THREADPOOL_IMPL -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-variable -Wno-unused-function -Wno-unused-result -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow -O3 -DNDEBUG -DNDEBUG -fPIC -DCAFFE2_USE_GLOO -DHAVE_GCC_GET_CPUID -DUSE_AVX -DUSE_AVX2 -DTH_HAVE_THREAD -DC10_BUILD_MAIN_LIB -fvisibility=hidden -std=gnu++14 -MD -MT c10/CMakeFiles/c10.dir/util/numa.cpp.o -MF c10/CMakeFiles/c10.dir/util/numa.cpp.o.d -o c10/CMakeFiles/c10.dir/util/numa.cpp.o -c …/c10/util/numa.cpp
…/c10/util/numa.cpp:6:10: fatal error: numa.h: No such file or directory
#include <numa.h>
^~~~~~~~
compilation terminated.
[3/1647] Building CXX object caffe2/CMakeFiles/torch_cpu.dir//aten/src/ATen/CPUGeneratorImpl.cpp.o
[4/1647] Building CXX object caffe2/CMakeFiles/fixed_divisor_test.dir/utils/fixed_divisor_test.cc.o
[5/1647] Building CXX object caffe2/CMakeFiles/variant_test.dir//aten/src/ATen/test/variant_test.cpp.o
[6/1647] Building CXX object caffe2/CMakeFiles/common_test.dir/core/common_test.cc.o
[7/1647] Building CXX object caffe2/CMakeFiles/inline_container_test.dir/serialize/inline_container_test.cc.o
[8/1647] Building CXX object caffe2/CMakeFiles/mobile_test.dir/opt/mobile_test.cc.o
[9/1647] Building CXX object caffe2/CMakeFiles/cast_test.dir/utils/cast_test.cc.o
[10/1647] Building CXX object caffe2/CMakeFiles/TopoSortTest.dir/core/nomnigraph/tests/TopoSortTest.cc.o
[11/1647] Building CXX object caffe2/CMakeFiles/smart_tensor_printer_test.dir/utils/smart_tensor_printer_test.cc.o
[12/1647] Building CXX object caffe2/CMakeFiles/device_test.dir/opt/device_test.cc.o
[13/1647] Building CXX object caffe2/CMakeFiles/NeuralNetTest.dir/core/nomnigraph/tests/NeuralNetTest.cc.o
[14/1647] Building CXX object caffe2/CMakeFiles/ssa_test.dir/onnx/ssa_test.cc.o
[15/1647] Building CXX object caffe2/CMakeFiles/text_file_reader_utils_test.dir/operators/text_file_reader_utils_test.cc.o
[16/1647] Building CXX object caffe2/CMakeFiles/torch_cpu.dir//aten/src/ATen/DynamicLibrary.cpp.o
[17/1647] Building CXX object caffe2/CMakeFiles/torch_cpu.dir/operators/conv_op_shared.cc.o
[18/1647] Building CXX object caffe2/CMakeFiles/dead_code_elim_test.dir/opt/dead_code_elim_test.cc.o
[19/1647] Building CXX object caffe2/CMakeFiles/math_test.dir/utils/math_test.cc.o
[20/1647] Building CXX object caffe2/CMakeFiles/converter_nomigraph_test.dir/opt/converter_nomigraph_test.cc.o
[21/1647] Building CXX object caffe2/CMakeFiles/net_async_tracing_test.dir/core/net_async_tracing_test.cc.o
[22/1647] Building CXX object caffe2/CMakeFiles/boolean_unmask_ops_test.dir/operators/boolean_unmask_ops_test.cc.o
[23/1647] Building CXX object caffe2/CMakeFiles/conv_to_nnpack_transform_test.dir/transforms/conv_to_nnpack_transform_test.cc.o
[24/1647] Building CXX object caffe2/CMakeFiles/utility_ops_test.dir/operators/utility_ops_test.cc.o
[25/1647] Building CXX object caffe2/CMakeFiles/operator_schema_test.dir/core/operator_schema_test.cc.o
[26/1647] Building CXX object caffe2/CMakeFiles/half_float_ops_test.dir/operators/half_float_ops_test.cc.o
[27/1647] Building CXX object caffe2/CMakeFiles/bound_shape_inference_test.dir/opt/bound_shape_inference_test.cc.o
[28/1647] Building CXX object caffe2/CMakeFiles/torch_cpu.dir/operators/communicator_op.cc.o
[29/1647] Building CXX object caffe2/CMakeFiles/conv_transpose_op_mobile_test.dir/operators/conv_transpose_op_mobile_test.cc.o
[30/1647] Building CXX object caffe2/CMakeFiles/common_subexpression_elimination_test.dir/transforms/common_subexpression_elimination_test.cc.o
[31/1647] Building CXX object caffe2/CMakeFiles/batch_matmul_op_test.dir/operators/batch_matmul_op_test.cc.o
[32/1647] Building CXX object caffe2/CMakeFiles/torch_cpu.dir//aten/src/ATen/Context.cpp.o
[33/1647] Building CXX object caffe2/CMakeFiles/torch_cpu.dir/operators/conditional_op.cc.o
[34/1647] Building CXX object caffe2/CMakeFiles/torch_cpu.dir/operators/conv_transpose_gradient_op.cc.o
[35/1647] Building CXX object caffe2/CMakeFiles/nnpack_test.dir/share/contrib/nnpack/nnpack_test.cc.o
[36/1647] Building CXX object caffe2/CMakeFiles/xla_tensor_test.dir//aten/src/ATen/test/xla_tensor_test.cpp.o
[37/1647] Building CXX object caffe2/CMakeFiles/torch_cpu.dir/operators/conv_transpose_op.cc.o
[38/1647] Building CXX object caffe2/CMakeFiles/depthwise3x3_conv_op_test.dir/share/contrib/depthwise/depthwise3x3_conv_op_test.cc.o
[39/1647] Building CXX object caffe2/CMakeFiles/wrapdim_test.dir//aten/src/ATen/test/wrapdim_test.cpp.o
[40/1647] Building CXX object caffe2/CMakeFiles/split_slss_test.dir/opt/split_slss_test.cc.o
[41/1647] Building CXX object caffe2/CMakeFiles/test_parallel.dir//aten/src/ATen/test/test_parallel.cpp.o
[42/1647] Building CXX object caffe2/CMakeFiles/graph_test.dir/core/graph_test.cc.o
[43/1647] Building CXX object caffe2/CMakeFiles/native_test.dir//aten/src/ATen/test/native_test.cpp.o
[44/1647] Building CXX object caffe2/CMakeFiles/NamedTensor_test.dir//aten/src/ATen/test/NamedTensor_test.cpp.o
[45/1647] Building CXX object caffe2/CMakeFiles/torch_cpu.dir//aten/src/ATen/DLConvertor.cpp.o
[46/1647] Building CXX object caffe2/CMakeFiles/undefined_tensor_test.dir//aten/src/ATen/test/undefined_tensor_test.cpp.o
[47/1647] Building CXX object caffe2/CMakeFiles/scalar_tensor_test.dir//aten/src/ATen/test/scalar_tensor_test.cpp.o
[48/1647] Building CXX object caffe2/CMakeFiles/weakref_test.dir//aten/src/ATen/test/weakref_test.cpp.o
[49/1647] Building CXX object caffe2/CMakeFiles/List_test.dir//aten/src/ATen/core/List_test.cpp.o
[50/1647] Building CXX object caffe2/CMakeFiles/pattern_net_transform_test.dir/transforms/pattern_net_transform_test.cc.o
[51/1647] Building CXX object caffe2/CMakeFiles/torch_cpu.dir/operators/concat_split_op.cc.o
[52/1647] Building CXX object caffe2/CMakeFiles/thread_init_test.dir//aten/src/ATen/test/thread_init_test.cpp.o
[53/1647] Building CXX object caffe2/CMakeFiles/torch_cpu.dir/operators/conv_gradient_op.cc.o
[54/1647] Building CXX object caffe2/CMakeFiles/generate_proposals_op_util_nms_test.dir/operators/generate_proposals_op_util_nms_test.cc.o
[55/1647] Building CXX object caffe2/CMakeFiles/torch_cpu.dir/operators/conv_op.cc.o
[56/1647] Building CXX object caffe2/CMakeFiles/reduce_ops_test.dir//aten/src/ATen/test/reduce_ops_test.cpp.o
[57/1647] Building CXX object caffe2/CMakeFiles/pow_test.dir//aten/src/ATen/test/pow_test.cpp.o
[58/1647] Building CXX object caffe2/CMakeFiles/int8_test.dir/operators/quantized/int8_test.cc.o
[59/1647] Building CXX object caffe2/CMakeFiles/generate_proposals_op_test.dir/operators/generate_proposals_op_test.cc.o
[60/1647] Building CXX object caffe2/CMakeFiles/tensor_iterator_test.dir//aten/src/ATen/test/tensor_iterator_test.cpp.o
[61/1647] Building CXX object caffe2/CMakeFiles/torch_cpu.dir/operators/conv_op_eigen.cc.o
[62/1647] Building CXX object caffe2/CMakeFiles/blob_test.dir/core/blob_test.cc.o
[63/1647] Building CXX object caffe2/CMakeFiles/ivalue_test.dir//aten/src/ATen/test/ivalue_test.cpp.o
[64/1647] Building CXX object caffe2/CMakeFiles/type_test.dir//aten/src/ATen/test/type_test.cpp.o
[65/1647] Building CXX object caffe2/CMakeFiles/cpu_rng_test.dir/__/aten/src/ATen/test/cpu_rng_test.cpp.o
ninja: build stopped: subcommand failed.
Building wheel torch-1.6.0a0+f463586
– Building version 1.6.0a0+f463586
cmake --build . --target install --config Release – -j 64
I run on linux server with user mode.
Could I install from source with cluster server?
Thanks,