How can I use all compute units on the GPU?

Windows 10 Task Manager shows only 1 of 2 compute units are being utilized on the 1080Ti.

Is there a way to get pytorch to use Compute_1 too?

Could you show me the output of nvidia-smi?

Snipaste_2019-01-09_23-54-55

So actually you can use tensors on the different cores. I believe you can do something like this if you want to use multiple cores during training: https://github.com/pytorch/pytorch/issues/13891.