Regularization on a subset of parameters

Have a look at this topic / answer: Don't Regularize Me, Bro