Exponential Moving Average in PyTorch

Exponential Moving Average (EMA) is an important feature in state-of-the-art research, in Tensorflow they already implemented it with tf.train.ExponentialMovingAverage. I wonder why the Pytorch team has not released an official version of EMA.

In others related question, there is no expert confirm that it is the correct implementation:

Or in this repo, the issue said there was some problem with the code.