What is the running mean of BatchNorm if gradients are accumulated?

thank you so much @crcrpar