Hi,
Thanks for your following up. It’s midnight here, and the GPUs are occupied. So I’m going to test it in a few days.
One interesting thing I found is that validation on CPU works fine via no_grad with same code.
My complex tensor slice might be potential reason, but I’m confused why the CPU RAM leak, not the GPU’s.