CUDA errors with CUDA 11.7 + dual RTX 3090 Ti

I resolved the problem by

  1. installing Ubuntu 23.04 instead of Ubuntu 22
  2. using the following CUDA and NVIDIA packages
  • NVIDIA-SMI 515
  • Driver Version: 515
  • CUDA Version: 11.7
  1. most importantly, tuning BIOS configs (enabling VT-d in BIOS was key for my machine)

Only applying 1 and 2 to my machine didn’t resolve the issue.