What does torch.backends.cudnn.benchmark do?

It depends on the task. If your input size is changing a lot, then it might hurt runtime, if not, it should be much faster.

7 Likes