Hello.
When looking at the source code of get_lr method in CosineAnnealing,
I wonder why the return value contains “(1 + math.cos(math.pi * (self.last_epoch - 1) / self.T_max))” instead of 0.5.
return [(1 + math.cos(math.pi * self.last_epoch / self.T_max)) /
(1 + math.cos(math.pi * (self.last_epoch - 1) / self.T_max)) *
(group['lr'] - self.eta_min) + self.eta_min
for group in self.optimizer.param_groups]
according to mathematical formula in the docs, when Tcur != (2k+1)Tmax
I think it should be multiplied by 0.5.