Yes. Here is way to do so - Does deepcopying optimizer of one model works across the model? or should I create new optimizer every time?