You probably saved the model as a nn.DataParallel module. Have a look at this thread.
nn.DataParallel