Do need to use model.eval() when I test?

1

HI I am new to pytorch.
I use dropout in training, so when I test the data, must I change
to model.eval()? I find I get different accuracy if I don’t add “eval()”
.
lass RNN(nn.Module):
def init(self,):
super(RNN, self).init()
self.lstm = nn.LSTM(input_size, hidden_size, num_layers, batch_first=False, dropout=0.5)
self.keke_drop = nn.Dropout(p=0.5)
self.fc = nn.Linear(hidden_size, num_classes)

Thank you for the help.

1 Like
2

Yes, otherwise, dropout layer still masks random outputs and the accuracy might be lower.

5 Likes
3

Sure, Dropout works as a regularization for preventing overfitting during training.
It randomly zeros the elements of inputs in Dropout layer on forward call.
It should be disabled during testing since you may want to use full model (no element is masked)

4 Likes
4

Thanks for your information Tzu Wei Huang.

5

Thanks for your time Jing. You explain very clearly.

6

Chinese? hahahah
You can also choose another choice like model.train(False)

7

yes. chinese haha
thank you for the reply