Gradients saturating to zero without learning

[codeislife99]

Yes, the issue was with the normalization of input data.I switched from using my normalization function to torch’s default image normalization and everything was fine.