Can you show the code? I am certain you  are concatenating it wrong: This will give you a tensor of (2,48,128)



 arvindmohan:

a = torch.randn(1, 48, 128) b = torch.randn(1, 48, 128) hidden = torch.cat((a,b))