Hi,
During the forward pass, the Tensor created there have requires_grad=False because we don’t track gradients for them.
The reason we don’t track gradients is because you provide a backward function that tells us how to compute them for that forward. So there is no need for the autograd to actually track that forward.