UserWarning: CUDA initialization: CUDA unknown error - this may be due to an incorrectly set up environment, e.g. changing env variable CUDA_VISIBLE_DEVICES after program start. Setting the available devices to be zero

25

I don’t know if these commands would help in your use case as I am using it on Ubuntu after it was suspended. I doubt this is the case for your servers so you might need to contact your admin to check why the init fails.