Data Loader Gets stuck when run on terminal, but runs when run through Pycharm

Data Loader Gets stuck when run on terminal, but runs when run through Pycharm.

If I run the script through the terminal, the data loader does not work but the cpu works in full load.

However, if I run the same script through the remote interpreter function of Pycharm, it works.
In the terminal, if I put num_workers to 0 then it works. However with more than 1 worker, the data loader does not work.

Are there any known issues on this? It is strange since in the terminal it does not work and in a remote interpreter of Pycharm, it works.

The following is the output of “conda list”

packages in environment at /home/jinwon/.conda/envs/raven_py3:

Name Version Build Channel

_libgcc_mutex 0.1 main
absl-py 0.9.0 py37_0
attrs 19.3.0 py_0
backcall 0.1.0 py37_0
beautifulsoup4 4.8.2 pypi_0 pypi
blas 1.0 mkl
bleach 3.1.0 py37_0
c-ares 1.15.0 h7b6447c_1001
ca-certificates 2020.1.1 0
certifi 2019.11.28 py37_0
cloudpickle 1.3.0 py_0
cudatoolkit 10.1.243 h6bb024c_0
cycler 0.10.0 py37_0
cytoolz 0.10.1 py37h7b6447c_0
dask-core 2.10.1 py_0
dbus 1.13.12 h746ee38_0
decorator 4.4.1 py_0
defusedxml 0.6.0 py_0
entrypoints 0.3 py37_0
expat 2.2.6 he6710b0_0
fontconfig 2.13.0 h9420a91_0
freetype 2.9.1 h8a8886c_1
glib 2.63.1 h5a9c865_0
gmp 6.1.2 h6c8ec71_1
grpcio 1.16.1 py37hf8bcb03_1
gst-plugins-base 1.14.0 hbbd80ab_1
gstreamer 1.14.0 hb453b48_1
icu 58.2 h9c2bf20_1
imageio 2.6.1 py37_0
importlib_metadata 1.5.0 py37_0
intel-openmp 2020.0 166
ipykernel 5.1.4 py37h39e3cac_0
ipython 7.12.0 py37h5ca1d4c_0
ipython_genutils 0.2.0 py37_0
ipywidgets 7.5.1 py_0
jedi 0.16.0 py37_0
jinja2 2.11.1 py_0
jpeg 9b h024ee3a_2
jsonschema 3.2.0 py37_0
jupyter 1.0.0 py37_7
jupyter_client 5.3.4 py37_0
jupyter_console 6.1.0 py_0
jupyter_core 4.6.1 py37_0
kiwisolver 1.1.0 py37he6710b0_0
ld_impl_linux-64 2.33.1 h53a641e_7
libedit 3.1.20181209 hc058e9b_0
libffi 3.2.1 hd88cf55_4
libgcc-ng 9.1.0 hdf63c60_0
libgfortran-ng 7.3.0 hdf63c60_0
libpng 1.6.37 hbc83047_0
libprotobuf 3.11.3 hd408876_0
libsodium 1.0.16 h1bed415_0
libstdcxx-ng 9.1.0 hdf63c60_0
libtiff 4.1.0 h2733197_0
libuuid 1.0.3 h1bed415_2
libxcb 1.13 h1bed415_1
libxml2 2.9.9 hea5a465_1
lxml 4.5.0 pypi_0 pypi
markdown 3.1.1 py37_0
markupsafe 1.1.1 py37h7b6447c_0
matplotlib 3.1.3 py37_0
matplotlib-base 3.1.3 py37hef1b27d_0
mistune 0.8.4 py37h7b6447c_0
mkl 2020.0 166
mkl-service 2.3.0 py37he904b0f_0
mkl_fft 1.0.15 py37ha843d7b_0
mkl_random 1.1.0 py37hd6b4f25_0
nbconvert 5.6.1 py37_0
nbformat 5.0.4 py_0
ncurses 6.1 he6710b0_1
networkx 2.4 py_0
ninja 1.9.0 py37hfd86e86_0
notebook 6.0.3 py37_0
numpy 1.18.1 py37h4f9e942_0
numpy-base 1.18.1 py37hde5b4d6_1
olefile 0.46 py37_0
openssl 1.1.1d h7b6447c_4
pandas 1.0.1 py37h0573a6f_0
pandoc 2.2.3.2 0
pandocfilters 1.4.2 py37_1
parso 0.6.1 py_0
pcre 8.43 he6710b0_0
pexpect 4.8.0 py37_0
pickleshare 0.7.5 py37_0
pillow 7.0.0 py37hb39fc2d_0
pip 20.0.2 py37_1
prometheus_client 0.7.1 py_0
prompt_toolkit 3.0.3 py_0
protobuf 3.11.3 py37he6710b0_0
ptyprocess 0.6.0 py37_0
pygments 2.5.2 py_0
pyparsing 2.4.6 py_0
pyqt 5.9.2 py37h05f1152_2
pyrsistent 0.15.7 py37h7b6447c_0
python 3.7.6 h0371630_2
python-dateutil 2.8.1 py_0
pytorch 1.4.0 py3.7_cuda10.1.243_cudnn7.6.3_0 pytorch
pytz 2019.3 py_0
pywavelets 1.1.1 py37h7b6447c_0
pyzmq 18.1.1 py37he6710b0_0
qt 5.9.7 h5867ecd_1
qtconsole 4.6.0 py_1
readline 7.0 h7b6447c_5
scikit-image 0.16.2 py37h0573a6f_0
scipy 1.4.1 py37h0b6359f_0
seaborn 0.10.0 py_0
send2trash 1.5.0 py37_0
setuptools 45.2.0 py37_0
sip 4.19.8 py37hf484d3e_0
six 1.14.0 py37_0
soupsieve 2.0 pypi_0 pypi
sqlite 3.31.1 h7b6447c_0
tensorboard 2.0.0 pyhb38c66f_1
terminado 0.8.3 py37_0
testpath 0.4.4 py_0
tk 8.6.8 hbc83047_0
toolz 0.10.0 py_0
torchvision 0.5.0 py37_cu101 pytorch
tornado 6.0.3 py37h7b6447c_3
tqdm 4.42.1 py_0
traitlets 4.3.3 py37_0
wcwidth 0.1.8 py_0
webencodings 0.5.1 py37_1
werkzeug 1.0.0 py_0
wheel 0.34.2 py37_0
widgetsnbextension 3.5.1 py37_0
xz 5.2.4 h14c3975_4
zeromq 4.3.1 he6710b0_3
zipp 2.2.0 py_0
zlib 1.2.11 h7b6447c_3
zstd 1.3.7 h0b5b093_0

1 Like

I have also had this bizarre issue and for some strange reason, it was related to importing matplotlib for me.

When matplotlib.pyplot is being imported, then setting num_workers > 0 works with pycharm but gets stuck with bash script.

When I do not import matplotlib, then it works fine.

Not sure what is going on.