I am trying to compute the SVD with PyTorch 1.9, using a Nvidia RTX 3080 with NVIDIA-SMI 460.91.03, Driver Version: 460.91.03, and CUDA Version: 11.2.
I get this error when I compute the SVD for a 24x128 matrix:
File "/home/kion/simclr-alignment/models/rank_loss.py", line 35, in forward U, S, V = torch.linalg.svd(A, full_matrices=True) RuntimeError: "svd_cuda_gesvdj" not implemented for 'Half'
Is this error caused by the matrix dimensions? Error also occurs when full_matrices=False.