RNN isn't learning, unsure what I'm doing wrong

nlp
5

A couple of other things you can troubleshoot are:

  1. Lower the learning rate;
  2. Try with the dataset from the tutorial, and if your model/training method learns on that, then we know the issue is with your dataset;
  3. Check the class distribution of your dataset - if it’s not balanced, you may need to apply a weight vector into the loss function. See here How do I get the accuracy of an unbalanced dataset or segmentation task? - #2 by J_Johnson