How Do I use Pytorch with RTX 5060 Ti

windows
1

Hello I’m new here. Can someone help me with this? I can’t find a compatible pytorch for my RTX 5060 Ti. Here’s my system and it’s issues. I’ve tried the nightly version and it still won’t work.

"Python 3.10.11

Checking PyTorch…
PyTorch Version: 2.8.0.dev20250618+cu128

Checking GPU and Driver…
Thu Jun 19 16:38:25 2025
±----------------------------------------------------------------------------------------+
| NVIDIA-SMI 576.80 Driver Version: 576.80 CUDA Version: 12.9

Checking CUDA Toolkit…
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2024 NVIDIA Corporation
Built on Fri_Jun_14_16:44:19_Pacific_Daylight_Time_2024
Cuda compilation tools, release 12.6, V12.6.20
Build cuda_12.6.r12.6/compiler.34431801_0

Checking PyTorch CUDA and GPU Compatibility…
CUDA Available: Yes
PyTorch CUDA Version: 12.8
GPU Compute Capability: (12, 0)
GPU Compatibility: Not supported by PyTorch 2.8.0.dev20250618+cu128. Try a nightly build: https://pytorch.org/get-started/locally/"

2

You’ve installed the right binary. Could you explain where this error message comes from as I haven’t seen it before?

3

I get the error when I install the pytorch nightly build or the stable version. I’m trying to run FramePack with GPU acceleration, and I get this error no matter what pytorch version I use. I have a batch file that checks for compatibility between PyTorch CUDA and GPU. When I run it I get the error. Every time.

4

I would recommend trying to install the latest stable or nightly PyTorch binary with CUDA 12.8 standalone without any 3rd party libs which seem to raise the error message.
Refer to e.g. this post for a smoke test.

5

Thank you. I will try that and let you know the results.

6

I switched to:
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2025 NVIDIA Corporation
Built on Fri_Feb_21_20:42:46_Pacific_Standard_Time_2025
Cuda compilation tools, release 12.8, V12.8.93
Build cuda_12.8.r12.8/compiler.35583870_0

Checking PyTorch CUDA and GPU Compatibility…
CUDA Available: Yes
PyTorch CUDA Version: 12.8
GPU Compute Capability: (12, 0)
GPU Compatibility: Not supported by PyTorch 2.8.0.dev20250618+cu128. Try a nightly build: https://pytorch.org/get-started/locally/

and I get the same error

7

Your locally installed CUDA toolkit won’t be used as the binaries ship with their own CUDA runtime dependencies. I would still recommend executing the smoke test I’ve linked before since you are still using 3rd party libs raising unknown error messages.