Is the loss function paralleled when using DataParallel?

you can wrap the loss function inside a DataParallel too if you’d like.