Yes - apparently now (in version 0.3.0) you can create 0-dimensional tensors. For example,
torch.zeros(0, 0) will give [torch.FloatTensor with no dimension].
So now you can do torch.cat((torch.zeros(0, 0), torch.zeros(3, 3))).