Hello, I’ve seen that L2 regularization is already part of the optimization algorithm (fx adam) but I was curios if something similar exists for L1? If not, could you give me some hints how I can implement it myself for all weights in a network?
Thanks in advance.
You could add L1 regularization using this example.
1 Like