Hi, I’m a little bit confused about when to update the Batch Norm statistics gamma and beta.
I’m doing transfer learning on a pre-trained model on the VGGFace2 Dataset.
My new dataset is quite similar (it contains only faces), so should I update the statistics or set Batch Norm layers to eval() ?