Reset adaptive optimizer state

[jpeg729]

Change learning rate in pytorch

You could try to use lr_scheduler for that -> http://pytorch.org/docs/master/optim.html