torch.cuda.stream(your_stream) do what you want, I guess 
And you can use multiprocess to launch the different process with different streams. Note that multiprocess with cuda is only suported in Python 3
torch.cuda.stream(your_stream) do what you want, I guess
And you can use multiprocess to launch the different process with different streams. Note that multiprocess with cuda is only suported in Python 3