Solved by ptrblck in post #2 
              
              
                torch.cat should work: 
a = torch.randn(5, 5, 1)
b = torch.randn(5, 5, 4)
c = torch.cat((a, b), dim=2)
print(c.shape)
> torch.Size([5, 5, 5])