Why sum of parameter of model increase after each iteration during train the model?

Right, thanks for updating the question!

I think .sum() will add the parameters themselves, not the number of parameters.

This topic seems to have a clean solution for counting parameters.