@ptrblck I know this might be a strange question but its related. I want to remember the previously used batch statistics (without using a running average) then evaluate on 1. Is that possible or is the only way to create my own batch norm layer?
see: How to use have batch norm not forget batch statistics it just used?