How to run sub operators in parallel by contrast with Sequential

Hi, I have a self-defined operator. For every layer, I need to run multiple operators in parallel, just like multiple convolutional kernels in each layer. As is known, nn.Sequential is a good way to run several operators in sequential order. But I can’t find similar class to run operators in parallel manner, may be nn.Parallel.

I have two optional methods to achieve the goal without considering running time or memory. The first one is to use for loop directly, and the second candidate is preparing multiple copies of the input. Both methods are naive and suffer from inefficiency in either running time or memory.

Is there any elegant way to achieve this?

Hi, I’m looking for exactly the operator you describe. If you’ve managed to find something, could you share it here?

Sorry, I haven’t found a solution too.