I need mean and variance values to do some operation. So I would like to get the mean and the variance values computed by BatchNorm2d on forward pass, as computing it twice is not ideal for me as evaluation time is extremely crucial in my usage.
Looking into the source code I noticed that cudnnBatchNormalizationForwardTraining function outputs the mean and the variance it computed. The question is, where are these values stored, and how can I access these values?