sorry, It was a mistake, I do not pass parameter. I am using 1.0.0 with python3.7. Should memory increase during inference if we use torch.no_grad(). I hope that only if the batch one uses during inference is bigger.