On Dropout on train and eval mode

if i call .eval() on my model that had dropout layers… does pytorch automatically scale the weights? and calling .train() will rescale accordingly as well?

Yes, the activations will be scaled automatically. In face this is done during training, while model.eval() just uses the model as it is.

1 Like

thank you very much for this