You can use Tensor.set_ from Python or C++ (ATen).
https://pytorch.org/docs/stable/tensors.html#torch.Tensor.set_ 1
But if you can save the storage offset before narrowing, why not just save a reference to the un-narrowed tensor?