How to fix my learning rate

You would have to call lrs.step() inside the DataLoader loop, which is most likely used inside your train method.
In my other post the range(nb_batches) loop would correspond to the DataLoader loop.