DDP taking up too much memory on rank 0

distributed
4

@PCerles I’m having a similar issue. Were you able to resolve your problem? Thanks.