IIRC, PyTorch RNN modules won’t activate past the sequence lengths if you pass it in as a packed sequence. http://pytorch.org/docs/0.2.0/nn.html#torch.nn.utils.rnn.pack_padded_sequence 100
Did you look into that as well? It shouldn’t hurt performance, right?..