Will `torch.manual_seed` in program A on cuda:A affect program B on cuda:B?

1

I recently know inside torch.manual_seed(seed), it calls torch.cuda.manual_seed_all(seed), which sets the seed for generating random numbers on all GPUs.

This brings me a question.
If I launch program A (use torch.manual_seed(3)) on cuda:0 and then program B (use torch.manual_seed(5)) on cuda:1, (Both are on the same machine), will program A end up in using seed 3 or 5 ?

2

If both scripts are started independently (e.g. in other terminals), the seeds shouldn’t have any influence, as the python programs won’t interact with each other.

1 Like