The Windows Task Manager might be misleading as you would need to enable the compute tab as also described here.
Alternatively, use nvidia-smi as it should show the utilization.
However, assuming you’ve moved the data and model to the GPU it seems to work as you don’t see a hang, so I assume the original issue is unrelated to the GPU usage.
1 Like