I defined a sentiment analysis model using lstm i usually do it with torchtext this this time i wanted to try it without. I used glove as embeddings and a 2 layers LSTM connected with a fc layer.
My problem is even if my gradients are changing the loss doesn’t change and I don’t understand why?
glove_mat is a matrix with size vocabulary*300(size of an embedding)
If you have any idea to change this ?