I understood that we nvidia drivers.
I understood that cudnn and nvcc comes with pytorch installation.
I understood that cuda version that I specify should be supported by the nvidia driver.
What is still not 100% clear is:
Do we need to install Cuda toolkit separately or is it taken care by the pip3/conda ?
Lets ignore the part of building custom cuda extensions and pytorch from source.