L1 regularization of a network


(Cirstea Razvan) #1

Hello, I’ve seen that L2 regularization is already part of the optimization algorithm (fx adam) but I was curios if something similar exists for L1? If not, could you give me some hints how I can implement it myself for all weights in a network?
Thanks in advance.


#2

You could add L1 regularization using this example.