Pytorch-CUDA 11.8 for Jetson Orin AGX

Hello everyone,

I am working on a Jetson orin AGX 32GB platform with jetpack 5.1 installed. I have to updated CUDA on my jetson to 11.8 and updated all my settings to CUDA 11.8 using link

I have checked the installation using nvcc --version which points to CUDA 11.8 and even the soft link to /usr/local/cuda and /usr/local/cuda-11 are pointed to /usr/local/cuda-11.8

Now I installed pytorch using the instructions given here

When I type torch.version.cuda it outputs 11.4. And I’m facing issues with this, because when I try to install pytorch-3d. Because it says pytorch is build for CUDA-11.4 but pytorch-3d is trying to build for CUDA-11.8.

Versions

Pytorch : torch-2.0.0+nv23.05-cp38-cp38-linux_aarch64.whl
Jetpack : 5.1.1
Platform : Jetson AGX Orin 32GB

I’m not sure why I’m facing this issue. Am I doing anything wrong here? or it this a limitation of this library?

Could anyone help me solve this issue?

Thanks!!

The linked wheel was built with the CUDA compiler shipped in the corresponding JetPack version, which was 11.4. If you need CUDA 11.8 for some reason, you would need to build the PyTorch wheel from source manually.

Where can I find instructions to build from source? Are there any specific set of instructions to build torch on jetson?

You can find the build instructions here.