So i have one output from a linear layer dimension torch.randn(8, 512, 2048).
i want to concatenate it with another tensor torch.randn(8, 512) to a
linear layer nn.Linear(2048+512, num_classes)
. how to do it?
thx in advance
You won’t be able to directly concatenate these tensors as the second one misses a dimension.
You could unsqueeze
the missing dim1
and expand
the tensor assuming you want to repeat its values 512
times.
1 Like
i have that for every sample input( batchsize = 8)( tensor torch.randn(8, 512)) i have a tensor of 512 which add information and should improve the model prediction. how to integrate this information, i thnk it doesnt make sense to repeat the values
This would work:
a = torch.randn(8, 512, 2048)
b = torch.randn(8, 512)
b = b.unsqueeze(1).expand(-1, 512, -1)
c = torch.cat((a, b), dim=2)
print(c.shape)
# torch.Size([8, 512, 2560])