Load/save of nn.DataParallel instance

I just found that nn.DataParallel works well even if there’s no available GPU.
Maybe it would better using nn.DataParallel all the time with or without GPU?