thanks a lot but I don’t want to train the test set just to use its own mean and std, instead of the mean and std of the testing set in other words not to apply model.eval I mean the beta and gamma are fixed and were computed on the test set
I am also getting similar problem. I am using modified HRNet model for my personal project, and the loss gets drastically large and unstable when testing, even with the training data. (0.006 → 0.014 ~ 0.04). According to other discussions, it must be related to using Batchnorm with small Batchsize, but there seems to be no fundamental solution to this.