Hi, But my single gpu cannot use batch size=32 which is out of memory. The single gpu limit the batch size <= 8. So I want to know when I use 4 gpus and each of which use batch size = 8 to train the model. is it right? Thanks a lot.
Hi, But my single gpu cannot use batch size=32 which is out of memory. The single gpu limit the batch size <= 8. So I want to know when I use 4 gpus and each of which use batch size = 8 to train the model. is it right? Thanks a lot.