Mismatch in output size for LSTMs by varying device

[ptrblck]

Seems to be related to this issue.