I don’t understand why the parameter
seq_len is called this way. As far as I know this is the number of sequences.
seq_len sounds like a sequence length, which is completely different thing.
Honestly the all terminology in documentation of RNN looks quite strange. Let’s take an example:
Description of the input to RNN (https://pytorch.org/docs/master/generated/torch.nn.RNN.html):
input of shape (seq_len, batch, input_size): tensor containing the features of the input sequence.
Do you see that? Tensor containing the FEATURES of the input sequence. So where do I need to provide the FEATURES? Because I only see following:
(seq_len, batch, input_size) - nothing about features.
In my opinion it should be
(number_of_sequences, number_of_elements, number_of_features), where usually we have
number_of_sequences sequences which are
number_of_elements long each having
number_of_features features isn’t it?
Sorry I am very confused, but maybe I don’t understand something so I would appreciate if someone can clarify.