Ubuntu 20.04: RuntimeError: CUDA error: all CUDA-capable devices are busy or unavailable

This error usually points to a broken driver/CUDA installation.
Are you able to compile and run other CUDA code such as the CUDA samples?