GPU memory consumption increases while training

10

Could you post a code snippet to reproduce this issue please?
Based on the description it seems as if memory is really leaked (not just increased to to e.g. storing the computation graph).