Solved by Toby in post #2 
              
              
                Extracting the sub-tensor directly from the origin will bring the whole storage of the origin. 
>>> import sys
>>> import torch
>>> tensor = torch.randn(10,3,128,128)
>>> sys.getsizeof(tensor.storage())
1966144
>>> sub1 = tensor[0]
>>> sub1.shape
torch.Size([3, 128, 128])
>>> sys.getsizeof(sub1.stor…