Cyclic Learning Rate

1

Hi,

Do we have implementation of cyclic learning rate for torch.optim.lr_scheduler?

Thanks

2

You can get it here, in class CyclicLR : https://github.com/thomasjpfan/pytorch/blob/401ec389db2c9d2978917a6e4d1101b20340d7e7/torch/optim/lr_scheduler.py

2 Likes
3

The function “torch.optim.lr_scheduler.CyclicLR” does not work in pytorch 1.0.1.
It says there the function is not defined

4

The function was added after 1.0.1 was released.
You could install the nightly build from here to get the method.

1 Like
5

i install the nightly version, but there is still “ImportError: cannot import name ‘CyclicLR’”

6

Could you print the PyTorch version you are using with print(torch.__version__)?
Also, could you post the line of code you are using to import CyclicLR?
I tested it two days ago and it was working.

7

thanks for your reply, is there something wrong with my import?

15%20AM
15%20AM1470×524 29.6 KB

8

1.0.1.post2 is not the nightly build.
Nightly build will contain the date in the version number, e.g. 1.1.0.dev20190422.

10

it works now, thank you so much