Example on how to use batch-norm?

cslxiao (Leon Freeman) June 19, 2017, 6:29am 15

Setting requires_grad to False only freezes the parameters, but not the case for the moving averages.
I need to freeze them all.

How to estimate batch normalization parameters for a separate test set or for the recently published breakthrough suggesting weight averaging leads to wider optima?