Two bias vectors in recurrent units?

[tom (Thomas V)]

Hello,

I think this is to match CUDNN:

Why RNN needs two biases?

As you pointed out it doesn’t really change the definition of the model, but this is what cuDNN does, so we’ve made our RNNs consistent with this behaviour.

Best regards

Thomas