I ran into a similar issue and made a mistake of using torch.reshape(x,(seq,batch,data)). But this resulted in messing the order of my time series data. The way I fixed was using torch.permute(x,(1,0,2))