Don’t say batch first if you don’t mean it. 
Best regards
Thomas
P.S.: Pro tip: PyTorch supports not passing the initial state (implicitly initializing to 0). Calling like that will give you a final state where you can read off the required shape.