Hi I have a question about saving the model.
I currently doing some project regard to knowledge distillation, so I load the pretrained teacher model in the student model.
When I finish the training, only thing that I want to save is the parameters of student model, but it seems that teacher model also included in the model save file.
How can I remove those teacher model automatically? Seems that register_buffer do this job but cant find the details of how to use it for complex model
Thanks