What is torch.cuda.empty_cache do and where should i add it?

vision
1

hi guys, i am new to pytorch and i was wondering what will torch.cuda.empty_cache() do? and where should i add it?
for example,

for epoch in range(epochs):
   train(......)
   torch.cuda.empty_cache()
   val(....)

or

for epoch in range(epochs):
   train(......)
   val(....)
   torch.cuda.empty_cache()
2

Hi,

This is a low level function to finely control some of the internals.
You don’t need to use it as it will slow down your code for no gain !

2 Likes