I have the same question! I believe it might have to do with the data format? For instance, if we are doing batch_first, then if we can preserve the hidden state, and sequentialize the data, then we should be able to pass in K batches corresponding to a regular old 1 x K batch when we do the unrolling. But I am not 100% sure…