When to initialize LSTM hidden state?

Hope this link helps: Initialization of first hidden state in LSTM and truncated BPTT.