I am using nccl backend to send and recv pytorch tensor on my server.
And I am trying to use these command to check the bandwidth usage, is it corrent?
Fisrt I use
as my dist utils.
And then I print
lo is the network interface used for loop.
Then I use
sudo iftop -i lo -n -P
But the bandwidth is too small.
WHat should I do to check the bandwidth uses of dist.send and dist.recv?