Can you clarify if your model trains properly, i.e., the training loss goes significantly down. I’m also not sure what you mean by “getting the same tensor value”? It’s always the same interdependent from the input?
Since you’re using view() a couple of time, you may want to check if it does the correct thing.
I’m also not sure about the last view() in general. lstm_out will have a shape of (seq_len, batch_size, 8). This means that lstm_out[-1] will have a shape of (batch_size, 8). Not sure why you do a view(1,-1) on that as this should return a shape of (1, batch_size*8). Am I misreading something?
Lastly you have 5 nn.LSTM layers each stack with 10/16 layers. That seems overkill and might take very long to learn properly.