I’m afraid that packed sequences aren’t compatible with DataParallel! It should raise an error, because I think that right now it computes sth invalid. A fix would be to do pack_padded_sequence inside the DataParallel part (so instead of wrapping self.lstm you’d wrap a module that does pack + self.lstm + pad).