From 0.3.1 onward, cuda capability 5.0 will not be included in the pre-packaged binary release (so all torch.cuda related stuff will not work).
You will be able to get pytorch to work with such architecture by compiling from source (so all operations will work).