I am new to pytorch and trying to learn from online examples. I tried to create RNN for classifying imdb reviews. My code is in gist here: https://gist.github.com/Chandrak1907/6b91dc1c19d613f6d1a2b22cf30c0ebf
I see that RNN accuracy is around 50% and parameters are not changing much during training.
Can you pls help me in identifying bug in my code?
Thank you,
You’re giving a very high learning rate(50). This would cause divergence in your loss surface and that’s why your parameters are messing up. Change the lr to something very small maybe 1e-2 or 1e-3 and try training again
hi @shahid, Thank you for reply. I tried various learning rates but no change in final accuracy.
Updated notebook is here - https://gist.github.com/Chandrak1907/24810970561db246458056d265d504be