I would recommend checking the datasets and actual training script as we have seen a few issues in this discussion board claiming a different GPU causes convergence issues while it was related to something else. Just recently this post claimed the same and it turned out some dataset folders were empty.