indramal
(Indramal Wansekara)
1
How to know if a model is run in CUDA cores or Tensor Core?
When we give the following code, model goes to CUDA cores.
device = torch.device("cuda:0" if torch.cuda.is_available() else "cpu")
model = model.to(device)
and then can check by using next(model.parameters()).is_cuda
.
How to run a model in tensor cores? and how to check if it runs in tensor cores.
You can benefit from nvprof
by Nvidia to profile it.
indramal
(Indramal Wansekara)
3
Please provide any examples with nvprof
Actually I haven’t tried yet. This package is provided by Nvidia and there are some tutorials on their developer website.
https://youtu.be/yyR0ZoCeBO8
eqy
5