Does pytorch support the conversion between tensor and mat (matlab data)?

Not directly, but you could load the MATLAB .mat with scipy.io.loadmat, get the matrices with the right key as numpy arrays, and transform them to tensors with torch.from_numpy().