Manual 2D Convolution per channel?

1

I have a tensor of size [Batch, Channels, H, W]

I want to manually apply a single 5x5 filter on every channel for every batch equally. How exactly do I do this?

I tried the following but it doesnt work:

N=5
kernel = torch.Tensor(np.ones((N, N)).astype(np.float32)) # Example 5x5 Kernel
kernel = kernel.unsqueeze(0).unsqueeze(0)
kernel = kernel.repeat((1, Channels, 1, 1))
kernel = {'weight': kernel, 'padding': N // 2}
tensor_conv = F.conv2d(tensor, **kernel)

I get:

tensor = torch.Size([2, 96, 64, 64]) #
tensor_conv = torch.Size([2, 1, 64, 64])

Why is the channel of the conv now only 1. I want the 5x5 conv to be repeated for all channels.

2

dim1 in a kernel is the number of input channels, while dim0 is the number of filters.
You could use a depthwise convolution as shown here:

x = torch.randn(1, 96, 64, 64)

N=5
kernel = torch.Tensor(np.ones((N, N)).astype(np.float32)) # Example 5x5 Kernel
kernel = kernel.unsqueeze(0).unsqueeze(0)
kernel = kernel.repeat((x.size(1), 1, 1, 1))
out = F.conv2d(input=x, weight=kernel, stride=1, padding=N//2, groups=x.size(1))
1 Like