How to root cause - torch/autograd/init.py:xxx: UserWarning: Error detected in GeluBackward0. Traceback of forward call that caused the error

whatdhack (Whatdhack) March 30, 2024, 2:49am 1

How do I dump more details or trace what exactly made autograd to fail ?

srishti-git1110 (Srishti Gureja) March 30, 2024, 2:38pm 2

Could you please post the relevant code and the full error trace?

whatdhack (Whatdhack) March 31, 2024, 6:35pm 3

It is part of a lager model. The relevant past is as follows.

nn.Linear(...)
nn.GELU()
nn.Linear(...)
nn.Dropout(..)

Not able to reproduce in a smaller code snippet. How do I trace the autograd process ? is it possible to get a more detailed log of the autograd process ?

Will have to clean up the log a bit before I can post.