While using nn.DataParallel only accessing one GPU

Yep, thanks a lot.
I have solved my problem, it’s true that I have passed the non-tensor type data for model forward computation. As you stated, “All tensors will be scattered on dim specified (default 0)”, so it’s better to format forward tensor data with the first dimension represent the sampling batch.
Have a good day!