Hello ,
I would like to know is there a rule or an equation of when a decay to the learning rate must be introduced ? Also in multiplying the old learning rate by the decay ratio is the best way ? and taking that value as 0.7 or some arbitrary value between [0,1]
and thank you.