It is because the .grad field is associated with the Tensor, not an entry in the Tensor.
So if you index the Tensor, you get some entries into it, but these are a new Tensor, and so with a different .grad field.