About LR range Test y OneCycleScheduler

Hi everyone,

I read the paper about LR range test

And the one about OneCyclePolicy

I copied this implementation of the LR range test

I’ve also documented myself about de OneCyclePolicy


It seems to be something many people wonder:

Suppose I have implemented correctly a LR Test

  • How is the correct orchestation between the optimizer and the one cycle scheduler? Because, the optimizer has the param lr, and the scheduler max_lr?
  • Can somebody provide me some example?, since I’ve been looking for it with no success


1 Like