if it’s a nn.GRU, i think you have to use the flag batch_first=True to make sure the inputs are interpreted to be having mini-batch in dimension-0
http://pytorch.org/docs/master/nn.html?highlight=batch_first#torch.nn.GRU 192