Understanding the use of Multi-GPU

Hi, In my lab we have several local machines (Desktops) equipped with 1080TI and Titan V on the same network. I have used multi GPU with pytorch on our server (In server we have bunch of Titan X), but never used in a way where I could use utilize the local machine’s GPU for my work.

is it possible to use Multi_desktop’s GPU for my work? any source?

Thanks

Hi,

The distributed module is built just for that !