What is the shared memory?

9

I am still a little confused. Let’s say I have 2 GPUs and would like to run 2 processes on each GPU. All 4 of the processes are independent.

May I ask some questions please:

  1. There is no need to use share_memory(), right?
  2. I just need to clone 2 models for each GPU and run multiprocessing of pytorch. Is that correct?
  3. Is there anything else I need to do?