I resolved the problem by
- installing Ubuntu 23.04 instead of Ubuntu 22
- using the following CUDA and NVIDIA packages
- NVIDIA-SMI 515
- Driver Version: 515
- CUDA Version: 11.7
- most importantly, tuning BIOS configs (enabling VT-d in BIOS was key for my machine)
Only applying 1 and 2 to my machine didn’t resolve the issue.