Hi, (I have combed through the similar topics on the forums and unfortunately still cannot find a solution for my problem) (venv_a100) [sergey_mkrtchyan@a100-demo cformers]$ nvidia-smi Thu Feb 18 17:10:56 2021 +-----------------------------------------------------------------------------+ | NVIDIA…

[image] mkserge: Edit: On further investigation it looks like the issue can be related to NVIDIA’s new MIG technology. It looks like with MIG enabled CUDA will enumerate only one device… I wonder if anyone has experience with that. Yes, that is the expected behavior. This post explains it a …

Torch.cuda.device_count() always returns 1

ptrblck February 19, 2021, 1:08am 2

Yes, that is the expected behavior.
This post explains it a bit more.