Different output from the same trained model

[nil_tdr]

Hello!

I trained my model and saved it. When I load the checkpoints from model.pth file and try to get output for different runs I am getting different outputs for the same input. Should not the weights and biases to be same for each testing of the model?

Thanks for your help!
Nil

[ptrblck]

@nil_tdr

Should not the weights and biases to be same for each testing of the model?

Yes and you can manually verify it by accessing and comparing the parameters of both models.

@nil_tdr

for different runs I am getting different outputs for the same input

Did you disable any randomness via model.eval()?

[nil_tdr]

No I did not. After doing it I have same output in every run. When I load saved model checkpoints why I have randomness?

[ptrblck]

You are most likely using some layers, which change their behavior between .train() and .eval(), such as nn.Dropout layers which will be disabled during model.eval(). It’s unrelated to loading a checkpoint and is just the model’s training state.