Change learning rate in pytorch

[norm_inf]

You could try to use lr_scheduler for that -> http://pytorch.org/docs/master/optim.html