Can the input of LSTM do not need hidden state?

I found that the input of the LSTM in the figure does not have a hidden state value. Does this setting make sense? So how does the LSTM obtain the value of the hidden state in the previous state during training?

As can be seen in the source code, the initial hidden state and the initial cell state are all initialized to 0 in this case.