Setting custom kernel for CNN in pytorch

you omitted bias=False in nn.Conv2d(n_feature, n_out, 3, padding=0, bias=False)