You can indeed check with .is_pinned().
Advanced indexing does not make any guarantee about copying or not unfortunately when you get the new Tensor. y = x[0] will most likely share memory.
Note though that x[bar] = foo will write into x even though y = x[bar]; y = foo might or might not