Unable to find a valid cuDNN algorithm to run convolution

Depending on the used device, the cudnn version, as well as the parameters of the convolution you might now see this error if no valid algorithm can be found from cudnn (instead of a CUDNN_NOT_SUPPORTED error or some-such).

Are you using torch.backends.cudnn.benchmark = True?
If not, you could try to activate it to use the cudnn heuristics and potentially query more algorithms.

If that doesn’t help, you would have to fall back to the native implementations by disabling cudnn via: torch.backends.cudnn.enabled = False.

Also, could you post the creation of the convolution layer and the input shape, please?
I would like to verify that indeed no algo can be found.

1 Like