Hi,
according to my understanding of GRUs, extending a sequence with zeros (-> sequence padding) should not make a huge difference in the final output, as long as the padded length is not too long.
I had a few problems in my latest network, until I figured out, that the difference between the several sequences was too big.
My first idea was to sort the sequences by their length, so that the total length difference in a padded batch would be as small as possible. Now I’m wondering whether there is an even better way to prevent the sequence padding to falsifie the networks output (by too much).
Thank you.
Regards,
Unity05