UserWarning: Detected call of `lr_scheduler.step()` before `optimizer.step()

[my3bikaht (Sergey)]

Look at this one:

`optimizer.step()` before `lr_scheduler.step()` error using GradScaler

Even though I think my code calls the optimizer.step via Gradscaler function before the lr_scheduler.step() function I am still getting this warning: /opt/anaconda3/envs/huggingface/lib/python3.7/site-packages/torch/optim/lr_scheduler.py:123: UserWarning: Detected call of lr_scheduler.step() before optimizer.step(). In PyTorch 1.1.0 and later, you should call them in the opposite order: optimizer.step() before lr_scheduler.step(). Failure to do this will result in PyTorch skipping the first v…