Solved by mxlei01 in post #2 
              
              
                Answer my own question here: 
Padding: 

You will need to pre-pad everything first, even with pack_padded_sequence. pack_padded_sequence will not pad for you, but instead will make sure that the RNN does not compute gradient on padded values.

DataLoader: 


Dataloader will not work with pack_padded…