Hey, I have the exact same error!
- My model doesn’t seem to be training.
- Upon checking a = list(model.parameters())[0].clone() and b = a = list(model.parameters())[0].clone() before and after the call to loss.backward() and optimizer.step(). a==b returns false
- Upon printing list(model.parameters())[0].grad it returns a matrix of all 0’s.
I’ve been struggling with this problem for 3 days now. Please help me out. The original question can be found at LSTM Model not training
@smth @apaszke @fmassa please take a look at this. I can share the complete code if I am missing out on providing some details now.