Technically, you can do that by reordering the dimensions of your input image such that the data has shape [N, channels, width, hight]
, but the question is whether you will get good results or not. In this case, then the width of your data will be very small (1 or 3 for gray-scale or colored image), so the size of kernel is also limited to the width.