Pytorch runtimeError:cublas runtime error : the GPU program failed to execute at /pytorch/aten/src/THC/THCBlas.cu:331

I run my program in pytorch environment, and I got a message like this:“RuntimeError: cublas runtime error : the GPU program failed to execute at /pytorch/aten/src/THC/THCBlas.cu:331”
How can I find a solution for this problem? Thanks for any help!

Could you post a minimal and executable code snippet reproducing the error as well as the output of python -m torch.utils.collect_env, please?