Solved by vdw in post #2 
              
              
                You might want to have a look at  previous post of mine, where I had a similar question. 
In general, you need to double-check with the documentation. According to that: 

hidden.shape = (num_layers*num_directions, batch, hidden_size)
layers can be separated using h_n.view(num_layers, num_directions…