Free GPU memory

1

I am trying to free GPU cache without restarting jupyter kernel in a following way

del model 
torch.cuda.empty_cache()

However, the memory is not freed. Could you tell me what I am doing wrong?

2

The memory will only be freed if you don’t have any reference to it left. It can come from your network inputs, your network outputs, your loss accumulation…

1 Like
3

Hi, does torch has tensor reference counter?

4

The Tensor objects are ref counted yes. It is done on the c++ side though via a shared_ptr-like system.

1 Like