What is maximum ammount of train steps in adam?

1

The number of steps is param of calculations in adam.
Does it mean with some step, updates would be around zero, or im wrong?

2

Hi, can you please elaborate your query a little bit? Are you referring to torch.optim.Adam?

3

Yes, this one


2 values depend on state[‘step’] var.
bias_correction1 change lr at the start of training. Then it always will be 1.
Im not sure about bias_correction2.