Weird CUDA illegal memory access error

I played around Wav2Lip
In my case:
imgs = torch.from_numpy(imgs).float().to(device)
generated the same error…

And I need explicitly set:

torch.backends.cudnn.benchmark = False # was True

and now it works like a magic!
What is the reason behind that?!
Cordially,
Constantine.