Gopal_Sharma:

How exactly variable length sequences are handled? How do you make sure that there is no backprop from sequences whose lengths are smaller than sequence of largest lengths?


@smth I’d love to hear an answer to this question as well.  Is it the case that there’s no backprop for padding tokens?  And if not is it simply zeroing the gradient or is it more complex?
Can you or someone on the team fill us in and/or point to the relevant place in the source where this is handled?