Where can I find the regularization loss implementation

Alpha · July 13, 2018, 4:21am

Hello,

can you help me to find the regularization loss implementation in Pytorch source code ?

Thank you very much !

beenfrog · July 13, 2018, 7:21am

The parameter: weight_decay in optim modules control the regularization.
For example the code in SGD

Alpha · July 13, 2018, 1:02pm

Thank you very much. In fact, I also want to find where the regularization loss is calculated ? can you help me?