Seperable conv in pytorch

vision
1

Is there a way to implement separable conv as a single layer in pytorch. Does pytorch have that node?

2

Assuming you are looking for a layer applying a depthwise convolution followed by a pointwise one, you could simply wrap both in a custom nn.Module to create a single layer.

3

That can be done but internally they are two different function call.Is there any possibility that they can be called using one single call?

4

No, I don’t believe any backend fuser is currently able to create a single kernel for them.

5

Is there a way to do that ?

6

Yes, you could write a custom CUDA extension as described here with your own kernel.

1 Like