saikrishnarallabandi:

the GRU hidden will not get updated during eval mode correct? why would shuffling make a difference in that case?


Yeah, but it is still sequence data. E.g., a text with a random sentence order would not make so much sense as having he sentences in the correct order.