How to use the UVA feature in PyTorch?

data
1

Hello, it’s my first time encountering the UVA (Unified Virtual Addressing) feature in PyTorch. I would like to understand whether, in PyTorch, we only need to use torch.Tensor to define a variable, and PyTorch will automatically set it as a UVA type for easy GPU access. Or do I need to set other parameters to meet this requirement?

2

Hi,

There is no UVA support in PyTorch. You should explicitly handle the move of your Tensors to and from the GPU. This more explicit control avoid subtle performance cliffs when using GPU.

3

@albanD is right, but it might also be worth checking the torch.cuda.CUDAPluggableAllocator which might allow you to experiment with a custom allocator.

1 Like
4

I understand now. Thank you very much for your response.