No hidden-out parameter in BiLSTM

1

I’m using a bidirectional torch.nn.LSTM and I want to make sure I freeze all of the parameters. When printing the named parameters, I get the list below. This list doesn’t include e.g. any hidden-out parameter, which makes me worried that I might not be freezing all the weights. Where’s the hidden-out parameter of the LSTM and all the parameters related to gating?

blstm.weight_ih_l0
blstm.weight_hh_l0
blstm.bias_ih_l0
blstm.bias_hh_l0
blstm.weight_ih_l0_reverse
blstm.weight_hh_l0_reverse
blstm.bias_ih_l0_reverse
blstm.bias_hh_l0_reverse
2

They are part of the _hh. See the “Variables” section in the LSTM docs.

Best regards

Thomas

1 Like