I am having a similar issue. Could you check it out? https://discuss.pytorch.org/t/using-amp-with-cuda-graphs-and-ddp-scaler-error/163671
I am having a similar issue. Could you check it out? https://discuss.pytorch.org/t/using-amp-with-cuda-graphs-and-ddp-scaler-error/163671