Can I access and call submodules of DDP model when training?

If you want to dig a bit into the code and see how DDP works check this post as I’ve shared a few references to see how the hooks are used and where the internal module is called.

1 Like