Where is running stats updated in Batchnrom (BN)?

1

Where is the running stats updated in Batchnrom layers? I was expecting to see something like:
running_mean = a * running_mean + (1 - a) * new_mean
But I did not find it here https://github.com/pytorch/pytorch/blob/master/torch/nn/modules/batchnorm.py

Do anyone have ideas?

Qiuqiang

2

I think the code is implemented in THNN and just called from Python. You can find the line of code here.