Hi, I am currently training a LSTM model for binary classification.
Although my training accuracy and loss are changing, my validation accuracy is stuck and does not change at all. Can someone help with solving this issue? Thank you!
p.s. Iearning rate =0.001 with adam optimizer and weight_decay=1e-4
Training Epoch 0 Loss: 0.6818549633026123 Acc: 75.0
Training Epoch 0 Loss: 0.33946362137794495 Acc: 87.5
Training Epoch 0 Loss: 0.573047935962677 Acc: 75.0
Training Epoch 0 Loss: 0.5953656435012817 Acc: 75.0
Training Epoch 0 Loss: 0.5127055048942566 Acc: 87.5
Training Epoch 0 Loss: 0.5791436433792114 Acc: 75.0
Training Epoch 0 Loss: 0.5615108013153076 Acc: 75.0
Correct: 2019 Total: 2808
Validation Epoch 0 Acc: 71.9017094017094 Loss: 0.5894517120387819
#####################################
Training Epoch 1 Loss: 0.5601013898849487 Acc: 75.0
Training Epoch 1 Loss: 0.5866733193397522 Acc: 62.5
Training Epoch 1 Loss: 0.73282390832901 Acc: 50.0
Training Epoch 1 Loss: 0.3902740478515625 Acc: 87.5
Training Epoch 1 Loss: 0.7055811882019043 Acc: 62.5
Training Epoch 1 Loss: 0.26922595500946045 Acc: 100.0
Training Epoch 1 Loss: 0.29699501395225525 Acc: 87.5
Correct: 2019 Total: 2808
Validation Epoch 1 Acc: 71.9017094017094 Loss: 0.522074056805199
#####################################
Training Epoch 2 Loss: 0.3273327946662903 Acc: 87.5
Training Epoch 2 Loss: 0.6666995286941528 Acc: 62.5
Training Epoch 2 Loss: 0.45028626918792725 Acc: 75.0
Training Epoch 2 Loss: 0.4807313084602356 Acc: 75.0
Training Epoch 2 Loss: 0.47266024351119995 Acc: 75.0
Training Epoch 2 Loss: 0.6877409815788269 Acc: 75.0
Training Epoch 2 Loss: 0.42089831829071045 Acc: 75.0
Correct: 2019 Total: 2808
Validation Epoch 2 Acc: 71.9017094017094 Loss: 0.5425263909235639
#####################################
Training Epoch 3 Loss: 0.5228984355926514 Acc: 75.0