I appreciate your time and reply.
That’s exactly my problem. I didn’t create “generate graph” in pytorch, in fact I use an external library for that. So I believe it causes the computational graph to detach as you mentioned.
I think I don’t want the “generate graph” block to be included in the training process (there is nothing to be learned), is that possible?