I do something like this to concatenate zero dimensional tensor to another tensor
A = torch.tensor([0]) # [0]
B = torch.tensor([1, 2, 3, 4]) # [1, 2, 3, 4]
C = torch.cat((A.view(1), B)) # [0, 1, 2, 3, 4]