Hi! I have a doubt regarding the combination of GPUs for training the models. I would like to use two 4090 RTX, but I saw that they do not have the NVLink capability. I do not know if it is possible to train a model by using two detached 4090 RTX since they do not have this capability. If I am not wrong, 3090 RTX has this capability (thanks to NVLink), so I suppose it is possible to combine them and use the two-combined GPUs for the training of the model.
If it is not possible, is it better to use 2x3090 RTX with NVLink or only one 4090 RTX? Otherwise, do you have any other proposals?