Yes, I noticed there is torch.index_select() function. However this function returns a new tensor not a view, so if I do
t2 = torch.index_select(t1,  axis, index)
t2 += 1.0

Tensor t1 will stay unchanged. I eventually need t1 to be changed.