I have PyTorch 1.7.1 and looking at this: pytorch/mkldnn.py at master · pytorch/pytorch · GitHub I don’t see support for MKLDNN for bidirectional LSTMs on CPUs. Also, when I run my code in verbose, I find calls only for MKL not for MKLDNN.
Am I missing something or there is no support of MKLDNN for bidirectional LSTMs on CPUs in Pytorch?
I am doing a comparison of LSTMs on Tensorflow/Keras and PyTorch so just want to be sure that I am not missing anything.