Does BatchNorm statistics need to be updated in Transfer Learning?

Hi, I’m a little bit confused about when to update the Batch Norm statistics gamma and beta.

I’m doing transfer learning on a pre-trained model on the VGGFace2 Dataset.

My new dataset is quite similar (it contains only faces), so should I update the statistics or set Batch Norm layers to eval() ?