Follow-up remarks:
Pytorch version: 1.0
Python installation of Pytorch: Using Anaconda
CUDA version: 9.0 (only used for training)
Libtorch was compiled from source. It is not possible to use the downloadable version because our project also relies on boost. The boost/Pytorch issue is discussed e.g. here: Libtorch does not link together with boost