RTX 2080Ti and RTX 2060 Data Parallel

1

Hello,

I am upgrading my machine from an RTX 2060 to RTX 2080Ti. I was wondering if I can leave the 2060 in there and use both GPUs with DataParallel(). I’ve used DataParallel() before but both the cards were 1080Ti’s. So my questions are:

  1. Can DataParallel() utilize the VRAM from both these cards despite them having very different specs?
  2. Would there be any complications with AutoMixedPrecision from APEX? Both the cards are RTX so they should (in theory) benefit from amp.

Thanks!

2

You can but it would be a mess.
They have way different amount of memory. The effective memory per gpu would be min(2060,2080). Therefore you would be wasting most of the 2080’s memory.

Same with computational power. 2060s will bottleneck the other one.

1 Like