Yup! You should be saving the tensors on the CPU side. When you store a reference to a tensor (i.e in a python List), they can’t be deleted by python garbage collection. So in the case of storing the Cuda Tensor, it just grows Cuda memory usage until it is full, where as CPU ram would be much larger.