Linear layer gradients of PyTorch and LuaTorch differs?

1

I tried to verify some equations with torch and pytorch, and accidentally found that the gradients differs.

2

Because you compute and accumulate gradients twice in Lua
A backward call is updateGradInput(input, gradOutput) + accGradParameters(input,gradOutput,scale)

3

Got it. Thank you :slight_smile: