How to create compound loss MSE + L1-norm regularization

4

You can compute L1 regularization manually like this:

regularization_loss = 0
for param in model.parameters():
    regularization_loss += torch.sum(torch.abs(param))
4 Likes