How to enable GPU Kernel peer to peer access

1

In Torch by doing the following, one could enable GPU kernel peer to peer access.

require 'cutorch'
cutorch.setKernelPeerToPeerAccess(true)

How can I do the same with PyTorch?

2

cudaDeviceEnablePeerAccess function is used to enable P2P access. An example of using this function is shown in simpleP2P.cu. But I would like to know if PyTorch provides any mechanisms to enable Kernel P2P access.

3

p2p is enabled in PyTorch (and cutorch) by default.

4

Thanks for your answer. I observed this behavior but I couldn’t find any information in the documentation.

5

Note that PyTorch enables P2P copies by default, but NOT P2P kernel access.

1 Like