Thanks for your response! I realize I mis-worded (and have since fixed) my question a bit. I said I would get an output tensor of size (3, <batch size>, <hidden_state_size>) but I meant (6, <batch size>, <hidden_state_size>) for a bidirectional 3 layer LSTM.
The question is: Are [0,:,:] and [1,:,:] of the hidden state output the first layer’s hidden forward and backward directions, respectively?
In other words, does the hidden state output (in order): Layer 1 Forward, Layer 1 Backward, Layer 2 Forward, … ?
Because I could see instead the output being  Layer 1 Forward, Layer 2 Forward, …, Layer 1 Backward, Layer 2 Backward … It seems unlikely it would be like this but I wanted to confirm it was not!