How pytorch's parallel method and distributed method works?

[dambo (Shlomo)]

Hello,
Is there any analogous version of DataParallel in C++/Libtorch?
Whatever I do on an exported traced model, it always uses only a single GPU.
Refer to: "Automatic parallelization of models onto multiple GPUs"