When to initialize LSTM hidden state?

[smth]

1. because otherwise it will reinitialize hidden layer to zeros (which means it does not remember across time steps). It works but performance wont be as good.

2. Yes this is okay to do but see if you have to adjust learning rate.