Hi,

Yes
What might enlighten you is this function: ctx.mark_non_differentiable() 10 that you can use during the forward pass to mark the outputs that won’t be differentiable (the outputs that won’t require gradients). All the other outputs of your autograd.Function will have requires_grad=True.