On Dropout on train and eval mode

#1

if i call .eval() on my model that had dropout layers… does pytorch automatically scale the weights? and calling .train() will rescale accordingly as well?

#2

Yes, the activations will be scaled automatically. In face this is done during training, while model.eval() just uses the model as it is.

1 Like
#3

thank you very much for this