Does torch.compile support inter-op parallelism?

I tried dynamic inter-op parallelism in TorchScript tutorilal with torch.compile and found that it makes forward and backward LSTM to run sequentially. Here is my notebook