I don’t think it’s possible. Could you just split the tensor and use the parts:
a = torch.randn(5, 3, requires_grad=True)
b = a[2].detach()
a = a[[0, 1, 3, 4]]
b.requires_grad
a.requires_grad

or could you explain your use case a bit more?