Could 1 machine with 8 GPUs run 2 DDP process?

distributed
1

Hi,

There are 8 GPU on my computer(1 computer).
I have run 1 process with 2 GPUs(index=0,1).
Could I run 1 more process on this computer with GPU 3 and 4?

2

Yes, you could execute multiple scripts and might want to mask the GPUs via CUDA_VISIBLE_DEVICES to make sure the current script sees only the desired devices.

3

Thank you!
It does work. I have just now tried.