How can I add different regularization to different layer

vision
2

You could add an own regularization term to each layer. This post shows a similar example for L1Loss but on each parameter.