Training does not use GPU at beginning

Hi folks,

Have you guys met a problem that a launched training process does not use GPU (or GPUs) at beginning. After a while, it starts to use the assigned GPU(s). I have encountered this problem many times. Not sure what’s the reason. Any suggestions?

Thanks!