Module.to('cuda') and optimizer initialization

1

From the PyTorch 1.4.0 docs in the torch.optim page:

image
image850×161 16.6 KB

Does this happen also when using .to('cuda')?

2

Yes, to('cuda') and .cuda() are equivalent calls.
Make sure to push the model to the appropriate device before creating the optimizer.