GPU- clear variable after use

[nstrek (Nikolay Strekopytov)]

You can try this snippet:

import gc
gc.collect()

with torch.no_grad():
    torch.cuda.empty_cache()

and read:

How can we release GPU memory cache?

This works only some of the times. Even when I clear out all the variables, restart the kernel, and execute torch.cuda.empty_cache() as the first line in my code, I still get a ‘CUDA out of memory’ error.

How to clear GPU memory after PyTorch model training without restarting kernel