Is there any example or related document which describes how to deal with variable length sequences in minibatch for 1D convolution?
Here is my detail situation.
I have two sequences with size : (#Channel, #Length).
Each pair of sequence have same length, but it differs within dataset.
For example, let’s say (X1,Y1), (X2, Y2) is paired data with size
X1.size() --> [5, 10], Y1.size() --> [3, 10]
X2.size() --> [5, 20], Y2.size() --> [3, 20]
My goal is learning the model f such that Y = f(X)
I am considering f as 1D convolution with batch normalization like,
h1 = bn(relu(conv(input)))
h2 = bn(relu(conv(h1)))
However, I am confused how to deal with multiple sequences in minibatch. If we zero-pad sequence when making minibatch, there seems no example to exclude zero-pad data involved in computation.