I am using pytorch 0.3.0. I’m trying to selectively copy a neuron and it’s weights within the same layer, then replace the original neuron with an another set of weights. Here’s my attempt at that:
reshaped_data2 = data2.unsqueeze(0)
new_layer_data = torch.cat([new_layer.data, reshaped_data2], dim=0)
new_layer_data[i] = data1
new_layer.data.copy_(new_layer_data)
First I unsqueezed data2 to make it a 1*X tensor instead of 0*X . Then I concatenate my layer’s tensor with the reshaped data2 along dimension 0. I then replace the original data2 located at index i with data1 . Finally, I copy all of that into my layer.
The error I get is:
RuntimeError: inconsistent tensor size, expected tensor [10 x 128] and src [11 x 128] to have the same number of elements, but got 1280 and 1408 elements respectively at /Users/soumith/code/builder/wheel/pytorch-src/torch/lib/TH/generic/THTensorCopy.c:86
If I do a simple assignment instead of copy I get
RuntimeError: The expanded size of the tensor (11) must match the existing size (10) at non-singleton dimension 1. at /Users/soumith/code/builder/wheel/pytorch-src/torch/lib/TH/generic/THTensor.c:309
I understand the error, but what is the right way to go about this?
PS: Also asked on SO, get some karma here