Is there a way to select one of the two inter-GPU interconnects available (PCIe and Nvlinks) during model training? Can I do this programmatically? I know Nvlinks are faster than PCIe but I’d like to have the flexibility of selecting one or the other, hopefully on the fly.
I don’t believe this is possible and NVLinks will be used if available. You could disable p2p in e.g. NCCL, which should then communicate through the host.