Way to speed up the training

vision
1

Hi all.
I have a TITAN Xp gpu and my model only use (700 / 12000 MB). so It have too much free memory.
I have some questions for use this gpu.

  1. Is there any way to speed up the training except to increasing batch size ?
  2. If I run five training model simultaneously (I think then 700 * 5 memory are used), No speed down ?
  3. Any recommend way to use gpu efficiently in my situation ?

Thanks in advance: