It should be different. In Case 1, all input sequence in the batch start with the same hidden state and are independent. In Case 2, the last hidden state of Step i becomes the initial hidden state for Step i+1. So each sentences in the batch start with a different hidden batch.