Agree with you. I tried looping through each time step in order to get the h and c of all time steps, and the computation is much much much slower than simply using h, _ = self.lstm(x).
It would be good to have output of nn.LSTM containing both h and c of all timesteps.