$ nvcc --version nvcc: command not found

I installed PyTorch from its original Website using conda

(base) mona@mona-ThinkPad-X1-Extreme-Gen-3:~/Downloads/debian$ python
Python 3.8.5 (default, Sep  4 2020, 07:30:14) 
[GCC 7.3.0] :: Anaconda, Inc. on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import torch
>>> torch.__version__
'1.7.1'
>>> torch.cuda.is_available()
True
>>> torch.backends.cudnn.version()
7605
>>> quit()
(base) mona@mona-ThinkPad-X1-Extreme-Gen-3:~/Downloads/debian$ nvcc --version
nvcc: command not found
(base) mona@mona-ThinkPad-X1-Extreme-Gen-3:~/Downloads/debian$ nvidia-smi
Fri Dec 18 14:37:44 2020       
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 440.100      Driver Version: 440.100      CUDA Version: 10.2     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  GeForce GTX 165...  Off  | 00000000:01:00.0 Off |                  N/A |
| N/A   42C    P8     3W /  N/A |    837MiB /  3911MiB |     21%      Default |
+-------------------------------+----------------------+----------------------+
                                                                               
+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID   Type   Process name                             Usage      |
|=============================================================================|
|    0       974      G   /usr/lib/xorg/Xorg                           133MiB |
|    0      1569      G   /usr/lib/xorg/Xorg                           365MiB |
|    0      1822      G   /usr/bin/gnome-shell                         320MiB |
|    0      2068      G   /usr/libexec/gnome-initial-setup               1MiB |
|    0     10971      G   /usr/lib/firefox/firefox                       1MiB |
+-----------------------------------------------------------------------------+

However, nvcc is not recognizer. It says CUDA is installed but I don’t have it installed here:
/usr/local/cuda/bin

I am using Ubuntu 20.04

I think you should install cuda from NVIDIA website.
@ptrblck: Does the NVIDIA binaries shipped with pytorch contain nvcc as well?

No, the CUDA compiler is not part of the binaries.
@Mona_Jalal you would need to install a CUDA toolkit in the matching version as used by your PyTorch binaries.