At the current time, it seems that model parameters trained on multiple GPU cannot be loaded to the model on the single GPU, nor reversely.
For example, I trained my model on two GPUs and then when I test the model, I would like to use only one GPU. But the parameters loading failed.
Does anyone has a solution?