Using dual model

I faced a big problem.

Model 1 was trained using a single model. Only inferences will be made without any backpropagation,
Since model 2 is a heavy model, it must be trained through two GPUs in parallel.

Can I get some code or advice?