Hi, I trained model on GPU and testing model on CPU. I found pytorch is not fully utilizing all the cores of CPU. I found most of the threads on my mac are not being utilized. In Tensorflow/keras it happens without updating any settings.
So, How to make pytorch model utilize all the cores of CPU while doing inference/prediction?