It should be possible to set the CPU affinity using NVML and Tesla GPUs for DDP.
You could probably use pynvml as a convenient Python API to create the affinity list and set it via os.sched_setaffinity.
However, I haven’t played around with it a lot.
1 Like