Tensor.long() precision problem

1 
a=torch.tensor([2.5])
b=(a-2.4)/0.1
print(b)
print(b.long())

outputs:

tensor([1.0000])
tensor([0])

Seemed .long() has a numeric precision problem.
Any ideas?

3

https://pytorch.org/docs/stable/torch.html#torch.round

4

No – that’s just how floating-point arithmetic works. print(b) rounds to 4 decimal points. If you print out b.item() you’ll see: 0.999999046325683 which rounds down to zero.

See Why 0.1 Does Not Exist In Floating-Point - Exploring Binary for more explanation.

1 Like