There isn’t a sequence in the hidden size.
So specifying batch_first does not affect the way you pass in the hidden state, and you would have to transpose that yourself.
While I see how this might not be aligned with the expectation, I’m not sure that people will be keen to change the input specification, given that it has been this way for quite a while.
Best regards
Thomas