The tensors with the provided shapes should work fine in torch.cat:
x = torch.randn(1, 128, 32, 160, 160)
x1 = torch.randn(1, 64, 32, 160, 160)
x = torch.cat((x, x1), dim=1)
print(x.shape)
> torch.Size([1, 192, 32, 160, 160])