Autograd + memory freeing + garbage collection

Continuing the discussion from Autograd + garbage collection:

I just realized this should be a part of the autograd cateogry and not a separate cateogry.
Could anyone please answer their thoughts on it?