You should be able to build PyTorch from source using CUDA 12.0, but the binaries are not ready yet (and the nightlies with CUDA 11.8 were just added ~2 weeks ago).
If you decide to build from source, note that a few fixes still need to land which are tracked here.
2 Likes