How to parallel two independent operations?

1

how to parallel the following two operations in pytorch?

a = w + x
b = y + z

Obviously, the computation of these two operations can essentially be paralleled. Is there any ways to do it?

2

If you’re working on CUDA, you can put those two operations on different CUDA streams: https://pytorch.org/docs/master/cuda.html?highlight=stream#torch.cuda.stream

3

Thanks! BTW, can you provide me with some sample code?