How to change two gpu parallel training to more gpus training


When i what to change the model trained on 2 gpus to 4 gpus, there is some mistake. Maybe the nn.Parallel has been used twice? But if i want change the gpu numbers, i can’t have any ideas.