You can do it similar as you would do it with numpy indexing. Like so:
 import torch
 x = torch.rand(5,4)
 loc = torch.ByteTensor([0,1,0,0,1])
 y = x[loc]

Storing in y the 2nd and 5th rows of the x tensor as indicated by the ones in your loc tensor. Is this what you need?