Solved by acobobby in post #4 
              
              
                Let’s say you have a hidden state of size (1, N, H) where N is the batch size and H is the number of hidden units.The 1 is there because I assumed you have 1 layer and no bidirectionality. 
So in your case you have 2 of these hidden states, one for each LSTM, and they may differ only in the value of…