[BUG] Weird behavior between evaluation and training mode

mfayyaz · February 6, 2018, 1:25pm

Thanks

Khalooei · February 6, 2018, 1:27pm

Hi Mohammad

output1:

output2:

As @mfayyaz and @ptrblck said, the issue would occur in BN section.

have a nice time

mderakhshani · February 6, 2018, 1:28pm

So what is the problem? You mean that .train(False) does not work properly?

ptrblck · February 6, 2018, 1:31pm

You have never set it to .train(False) in your training script. You just disabled the gradients.
That’s why BatchNorm still updated its running_* stats.

mderakhshani · February 6, 2018, 1:37pm

Okay. I have got it. Thank you