Im pretty new to PyTorch and working on my first training. I noticed that after an epoch of training when I did validation without going into eval mode and using the no_grad, GPU memory consumption goes sky high until there is no GPU memory left. It would be awesome if somebody could explain what is happening under the hood and causing such thing.