Check which tensors are on cpu

1

I am using hugging face library in order to fine tune recogniton for a local dialect. Before it was working very well, but since yesterday I am becoming error:

RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument weight in method wrapper___slow_conv2d_forward)

The model is downloaded from hugging face hub and I made sure, that all input data is on cuda:

image
image1920×1364 70.7 KB

image
image1552×474 113 KB

From the screenshots above you may see, that input values are on cuda.

As a standard I also moved whole model to the cuda:

from transformers import Wav2Vec2ForCTC

model_name = "jonatasgrosman/wav2vec2-large-xlsr-53-german"

model = Wav2Vec2ForCTC.from_pretrained(model_name).cuda()

In case of my runtime error I’d like to know what exactly is still on cpu and how possibly could I solve that problem :pleading_face:

2

Based on the stacktrace a conv layer seems to run into the device mismatch error.
Check where the .device attribute of all parameters of all conv layers and make sure they are also on the device.

1 Like
3

Thanks for reply. I have gave up and started following tutorial again. Now it’s working perfect xD