Finding the cause of RuntimeError: Expected to mark a variable ready only once

model_1 = DDP(model_1, find_unused_parameters=True, device_ids=[rank]
model_2 = DDP(model_2, find_unused_parameters=False, device_ids=[rank]
Hopefully, this works for you.

1 Like