Adaptive learning rate

13

You can change lr in this way as @trypag mentioned[quote=“trypag, post:4, topic:320”]
for param_group in optimizer.param_groups:
<\t>param_group[‘lr’] = lr
[/quote]
no state loss anymore

2 Likes