BiLSTM hidden states and output don't match

2

You’re actually comparing the first output of the reverse direction. I think you want out[0, :, 500:]

Screen Shot 2017-05-31 at 12.56.45 PM.png583×640 37.9 KB