Yes, that’s the point. It should still improve, but it does not improve, I do not know why. And yes, I have 10 balanced classes, so for the first epochs an accuracy of around 10% is expected, but then it should change if weights change
I solved… mistake was that I was calling again model = TextNN() after instantiating the optimizer, so weights were not changing… So, every part was ok, apart from the optimizer that was working with another (unused) model.