Is there any way to do that? The L-BFGS optimizer does not have a weight decay option, and adding a explicit weight decay throws an error inside the closure() claiming that gradients have been released.
2 Likes