Does PyTorch now support CUDA 11.2?

The option for 11.3 is available but im not sure whether it will support ?

Yes, you can build PyTorch with any CUDA version >=10.2. The binaries are currently built with CUDA10.2 and CUDA11.3.