No, I mean you need gradient flow through the action log probability path, but requires_grad “probably” truncates it, normally I would not perform any other modifications to these tensors in the grad path except adding/multiplying them.