How to create compound loss MSE + L1-norm regularization

You can use nn.L1Loss. See this post Simple L2 regularization?.