Hey!
Yes, there is a tab. Somehow got rearranged while copying code. Inference is being done with torch.no_grad() context manager.
I am pretty sure gradients are not computed, but gpu memory steadily increases during consecutive forward passes.
Thanks.