Model.to("cpu") does not release GPU memory allocated by registered buffer

[ljj7975 (Brandon Lee)]

“you cannot delete the CUDA context while the PyTorch process is still running”

Clearing the GPU is a headache

No, you cannot delete the CUDA context while the PyTorch process is still running and would have to shutdown the current process and use a new one for the downstream application.