The binaries will not use your local CUDA toolkit as described in this topic already.
If your PyTorch install shows that the CUDA 10.2 runtime is used you have either used the wrong install command, have an older PyTorch installation, etc.
You can check it via pip list | grep torch and conda list | grep torch. Make sure only one PyTorch binary is installed and that it shows the desired CUDA runtime.
If you want to use CUDA 11.7 you could build PyTorch from source. The nightly binaries with 11.7 are building already, but not in the install matrix yet.