PyTorch Forums
`AveragedModel` and FSDP2
distributed
torchtitan
Chenchao_Zhao
(Chenchao Zhao)
April 15, 2026, 4:16pm
1
Is there a way to combine AveragedModel with modern ND parallel or at least FSDP2 with DTensor?