In my codes, I have used torch.clamp as follows:
epsilon = 1e-6
ypred = torch.clamp(ypred, epsilon, 1-epsilon)
and got error message as follows:
Error: Function ‘ClampBackward’ returned nan values in its 0th output.
I have no idea what the problem is. Any suggestions?
Non-finite value is introduced somewhere later.
Following gives the same error; Inf values are not considered anomalous for some reason…
Thanks. Your reply is very helpful.
how to solve this problem, please?
it is a generic numerical problem, topic’s case was about Inf values produced in forward
i download codes from github, i check code and do not find nan, how to deal with this problem, thank you
i check codes and do not find div zero
use a debugger, ensure that your loss (forward output) contains non-finite values (perhaps at some epoch > 1), re-run forward() step-by-step to find the problem (you can use conditional breakpoints and “jump to cursor” in pycharm’s debugger). Sorry, I cant think of an easier way.
i meet this problem at about 20 epoch, debug may need one day