I have a question regarding training the model one layer at a time in a self-supervised manner. For example, I need to train Alexnet first conv layer, then save the model. After that, load the model, freeze the weights and add another conv layer and keep on repeating the process until it trains on all the five conv layers.
I am not sure how to approach this task. I can think of saving the entire model instead of just saving the state_dict, and then pass the model to another class that is having one more conv layer. So, In this way, I am supposed to create 5 classes for each conv layer. In the final step, I need to load the last model contains all five layers and train it in a supervised way.
Is there any other better way to do this?.