Like https://github.com/Element-Research/rnn 120 has MaskZero module, won’t PyTorch also need a wrapper to deal with padded inputs and gradients between LSTM outputs and final layer? Is there any plan for that or is there other elegant way to deal with it?