What about ShortTensor?
http://pytorch.org/docs/master/tensors.html#torch.ShortTensor 64
Btw: I found that the problem occurred because some of my labels were loaded as uint16 and some as int16. The former type is not supported and breaks the from_numpy() function.