Hm, so it’s the regular RAM not the GPU memory? I had some issues with GPU memory & the batch loader when runs got aborted (the process kept running in the background, PyTorch doesn’t free GPU’s memory of it gets aborted due to out-of-memory error). It’s probably not related since you mention the memory increases during the run. Sorry, I have no idea what could cause that in your case.