refe to Calling loss.backward() reduce memory usage?
Free graph of last iteration will help you save gpu memory, this made my bachsize doubled.
refe to Calling loss.backward() reduce memory usage?
Free graph of last iteration will help you save gpu memory, this made my bachsize doubled.