you simply do:
loss1 = criterion1(input1[:, 0])
loss2 = criterion2(input1[:, 1])
torch.cat(loss1, loss2, dim=0)

(an example of a two-criterion case is shown, if you have a lot of criterion, just do a for loop)