I finished trained teacher model and I can save and reload teacher model’s weight, feature map etc.
So I want to do is making similar student’s first layer output feature map with teacher’s.
Teacher have 5x5 filter, student have 3x3 filter.
But I don’t know how to coding the loss or feature map comparing part.
Thank you.