See here the answer by Sowmith himself. I hope thats what your are looking for Normalization in the mnist example