Pytorch Installation SSH

vision
1

Hello everyone,

I am using my virtual computer connected through ssh. I want to install pytorch for my llava model but I am not sure which version is good with my spec now. Wishing the helps from all.

The problem is I am encountering now, cuda version 12.2, but the cuda compilation tool 10.1, and I have my own new cuda environment.

2

Your locally installed CUDA toolkit won’t be used unless you build PyTorch from source or a custom CUDA extension. You need to install a compatible NVIDIA driver, the PyTorch binaries afterwards, and it should work.