My batch_size is 4. Input X is (batch_size, 129, 64). RNN outputs (batch_size, 129, 516). Then I pass the output through a .contiguous.view(-1, 516), which gives me a size of (4, 516), which I pass through a linear layer to get size of (516, 6). However, I need it to be (4, 6) at the end.