Adding L1/L2 regularization in a Convolutional Networks in PyTorch?

You could implement L! regularization using something like example of L2 regularization.
For L1 regularization, you should change W.norm(2) to W.norm(p=1).

1 Like