Best Practice for initialize hidden and cell state LSTM

vision
1

Hi I’ve been wondering what’s the best way to initialize hidden and cell state.

  1. Initialize it to zero
  2. Initialize it to random number

Please give me the reasons, thanks :slight_smile:

1 Like