hey @ptrblck, thanks for replying.
Indeed the problem is related to improper download of the torch file, When I try to access the .pth file(168 MB) through git lfs, it just gives a log file of 12 kb, that is why the error occurs.
So, I was thinking of what is another way to download a weights file, either drive or something else
For future visitors- this might be happening because transformer model sharing makes use of git lfs system. So the pytorch_model.bin, that got downloaded is just a pointer.
As @Anubhav1107 pointed out, you can download the file instead of pointer, and you should not get this error.