I have the code below and I don’t understand why the memory increase twice then stops
I searched the forum and can not find answer
env: PyTorch 0.4.1, Ubuntu16.04, Python 2.7, CUDA 8.0/9.0
from torchvision.models import vgg16
import torch
import pdb

net = vgg16().cuda()
data1 = torch.rand(16,3,224,224).cuda()

for i in range(10):
    pdb.set_trace()
    out1 = net(data1)


first stop, this is what data1 and vgg16  take


second stop, this is what the intermediate status of vgg16 take


third stop, WHY it increase again?


forth stop, WHY it stops increasing?