You could use gradients in the input tensor to update the input directly, e.g. for an adversarial attack.
I’m not sure, when gradients in the target are useful (as you could potentially update the target), but there are most likely use cases I’m not aware of.