feat = Net1(input)
output = Net2(feat)

If I freeze Net1 by eval(Net1), does this save memory in my GPU?
The gradient need not to be computed in case of frozen layers, thus lesser memory. But I don’t see much change in the memory allocated between frozen layers and trainable layers? Is the memory difference very small?