Understanding GRU/LSTM layers parameter

[timdnewman]

If anyone comes looking at this - someone just asked a similar question and got an answer they are the same:

Is there any benefit to stack multiple GRU one after the other?

I’m working on time series problems. On the web I saw 2 type of models: Models which used one GRU with multiple layers. nn.GRU(num_layers=4,…) Models which used multiple GRU's (one after the other) with less (or equal) number of layers. nn.GRU(num_layers=2, ...) nn.GRU(num_layers=2, ...) I understand that using one GRU or multiple GRU change the number of wights to calculates and to optimize, but I didn’t found any explanation for the benefits between the 2 options above: What is …