@kleingeo yes, the solutions suggested in this topic don’t work anymore since some time. In another post I have found the precise commit that broke them, see here
Basically changing track_running_stats after Batch norm has been created will not have any effect (or at least not the intended one).
But you can do it when you create it.
BatchNorm(..., track_running_stats=False). This will work in running batch norm as in Eval mode.
Try it and let me know 