'DistributedDataParallel' object has no attribute 'my_custom_method'

distributed
1

I had run my command on Terminal as below
$ python -m torch.distributed.run --nproc_per_node=2 train_ddp.py

and in my code, I had used “module” attribute before accessing my_custom_method like below
“out = model.module.my_custom_method”
but looked like that DDP still can not access my custom method. The error was shown as below

==> ‘DistributedDataParallel’ object has no attribute ‘my_custom_method’

Please help to advise. Thanks.

2

Could you share a code snippet that can reproduce the error?

3

Hi Andrew, thanks… I resolved my problem. Thanks…

4

Hi, could you tell me how did you resolve it? Thanks