As you can see in definition of the LSTM module here 51, the output will give you the last layer hidden layers in all timesteps.
output of shape (seq_len, batch, num_directions * hidden_size): tensor containing the output features (h_t) from the last layer of the LSTM, for each t.