When will CUDA 12.4 be compatible with Pytorch 2.3?

[ptrblck]

@plumberpt

Now no access between Pytorch 2.3 and Cuda 12.5. I think Pytorch 2.3 currently does not support Cuda 12.5. Support for Cuda 12.4 in Pytorch 2.3 is coming.

PyTorch 2.3 does support CUDA 12.5 if you build from source. The binaries (pip wheels and condo binaries) whip with CUDA 11.8 or 12.1.
The current nightly binaries ship additionally with CUDA 12.4.
However, as already mentioned your locally installed CUDA toolkit won’t be used and the shipped CUDA dependencies will be used.

@plumberpt

*** Meaning Pytorch and DRS 19 will use their respective installed Cuda versions? Use PIP to install specific Cuda version for Pytorch?

I don’t know what DRS does, but PyTorch binaries install all needed CUDA runtime dependencies during the install process and will use these.

@plumberpt

Will wait for Pytorch 2.4 full release at the end of Jul and then install with PIP3 … Bingo.

The nightly binaries already build with 12.4.