Is there any method to show the details when we run loss.backwards()?
Since when I run a single line loss.backwards(), the GPU memory increases a lot (Inference 4GB, when run this line, the GPU memory cost will be 12GB). So I think if I can track the backward graph details then I can find where is the problem.
For now, I could just run this single line and get a bad result…
Thanks very much for any helps.