Yes, I think this is generally a valid assumption and should be true as long as you don’t use e.g. the .data attribute of a tensor. If the operation is not differentiable or not implemented, Autograd would raise an error.



 ptrblck:

will be tracked by Autocrat





 drevicko:

AREN’T tracked by Autocrat


Also, interesting autocorrect when trying to type “Autograd”, but I think in the end my smartphone might know who has the absolute power in PyTorch land.