I’ve looked into the torch.distributed of both torch1.13 (Distributed communication package - torch.distributed — PyTorch 1.13 documentation) and torch 2.0 (Distributed communication package - torch.distributed — PyTorch 2.0 documentation). I noticed that the variable “local_rank” has been modified to “local-rank”. Is this an intentional change or an error?
This looks like it was a result of a better-engineering change: [BE] Prefer dash over underscore in command-line options by XuehaiPan · Pull Request #94505 · pytorch/pytorch · GitHub