How i can pass iteration to Lambda LR instead of Epoch
I want to varry my LR using this function after running it with flat LR for certain number of iterations
def sched_cos(start, end, pos): return start + (1 + math.cos(math.pi*(1-pos))) * (end-start) / 2
Where pos=iteration number
My objective is to train with Flat LR for certaion portion of training cycle say 30 percent then there after decay the LR as per cosine function … Some thing like that as shown in image. Green Line.