I assume that by slice you mean subset of a tensor right? like t.select(0, 1)?
If so, the new tensor is actually looking at the same memory as the original one. So it is still pinned memory and no need to copy it.