If the sequences within and between batches are independent, then it shouldn’t really matter which  one of the 32 hidden states you should pick, being the topmost, bottommost, or any other one. Arguably, if you train a large amount of epoch with enough shuffling, the 32 hidden states should be kind of similar.
Or you simple make 32 inferences with for the same input sequence but with all 32 available hidden states and see if it effects the result in any way :).