Hi all. I recently build pytorch from master, and it cost more GPU memory compared to the released 0.2.0.
I test GPU memory usage using the official imagenet example(Titan Xp, batchsize32). The numbers are as following:




Arch
master
0.2.0




resnet50
5215MB
4169MB


resnet101
7547MB
5711MB


resnet152
10217MB
7495MB



As you can see — quite a lot. Also I have tried the 0.3.0 branch, where the GPU memory usage is almost the same with 0.2.0.
Anyone have the same issue?