albanD:

The intermediate Tensor will have have their requires_grad=True in python. So you can use that as a hint if they are used in the computation of something that needs gradient computed.


Yes, exactly. Somehow, it completely slipped my mind even when I checked the grad_fn attribute of the score variable in question.