CUDA error when loading my model

This error would mea that your GPU is running out of memory and you would have to lower the memory usage by e.g. lowering the batch size of the input.
If that’s not the case and you are immediately seeing the issue using any CUDATensor, then I guess it’s a double post from here, which you’ve marked as solved.

1 Like