Parallel Process In Pytorch

Hello I want to create a parallel mechanism in my CNN. for example I have a 2 kind of convolution and wants to run it in parallel scenario so I can save more time. The scenario can be different convolution like Figure 1 or different CNN network but with the same input image like in Figure 2. How can I do it in just 1 GPU and if possible How can I do it in 2 different GPU?

[Figure 1]

[Figure 2]

1 Like

torch.multiprocessing is likely your best bet! http://pytorch.org/docs/0.2.0/multiprocessing.html