Ddp distributed training card 0 occupied more space

2

Double post from here with follow-up.