How to check gradients?

[eqy]

You should be able to access the .grad attribute of your model tensors (e.g., via net.parameters()) and use that to compute the statistics you wish.