Changing network architecture after first round of training

Hi all,

I’m looking to train my model to do one thing (maybe that’s officially called “initialising” the network or something), then train it to do something else once it has learned some features. I’d like to add some more nodes at each layer at this point.

What’s the recommended way of doing this in pytorch?