The short answer is, because it adds complexity for better performance and some users might be OK with a single line of code change instead of setting up the DDP workload.
Besides the tutorial you could also have a look at the ImageNet example to see, how to properly use it.
2 Likes