CUDA device error: CUDA-capable device is/are busy

1

Has anyone met this problem before? I ordered 2 GPU on one node

image
image1894×631 64.9 KB

2

What does “I ordered 2 GPUs” mean? Are you using a shared node? If so, is another user blocking the devices? Are you able to use both devices standalone?

3

Hi, they are on a shared node.

1691659566868.png
1691659566868.png652×838 28.3 KB

4

In that case the error is expected since all your GPUs are in Exclusive Process compute mode.

5

Sorry for the late reply and thank you so much for your suggestion!