Rnn with sigmoid activation function

vision
1

I am trying to rebuild a Matlab architecture in pytorch and they used sigmoid for hidden layer activation. Can sigmoid be used in RNN cell instead of tanh or ReLU? I mean, here is pytorch RNN source code,

capture_20181219103538

there are 2 options in default source code (which are tanh and ReLU) and I could not find rnn_sigmoid_cell or something like that. Is there a “rnn_sigmoid_cell” function ?

1 Like