Do you have some code of your model to show? There are typically 2 issues that often crop up yielding subpar results:
-
The incorrect output from the LSTM layer is used for further processing
-
The data gets scrambled up due to inconsiderate use of
view()
orreshape()