DataParallel vs DistributedDataParallel

But DataParallel also enable multiple GPUs, in one node/machine, right?