Torch.save()/can not save the whole tensor if the tensor takes more than 10 GB storage

data
1

What should I do to deal with this problem?

Thank you very much in advance!

2

I cannot reproduce the issue in a recent master build and am able to save a tensor of e.g. 16GB using:

>>> import torch
>>> x = torch.randn(int(4*1024**3), device='cuda')
>>> print(torch.cuda.memory_allocated()/1024**3)
16.0
>>> torch.save(x, 'tmp.pt')
>>> y = torch.load('tmp.pt')
>>> print(y.shape)
torch.Size([4294967296])
3

I used the same operation as you, but an error occurred when I load the built tensor.

image
image1403×378 27.5 KB

4

I’m not sure if this issue might be Windows-specific, but could you update PyTorch to the latest nightly release and check, if this might have been an already known and fixed issue, please?

5

I will try according to your suggestion. Thank you for your help!