Hi all. I recently build pytorch from master, and it cost more GPU memory compared to the released 0.2.0.
I test GPU memory usage using the official imagenet example(Titan Xp, batchsize32). The numbers are as following:
As you can see — quite a lot. Also I have tried the 0.3.0 branch, where the GPU memory usage is almost the same with 0.2.0.
Anyone have the same issue?