Solved by TripleTry in post #3 
              
              
                Thank you very much , I have solve this problem. 
There is something wrong with my dataloader function, when I load data, I use padding to process my data, but I forgot to turn list into tensor, as a result nn.Dataparallel to split data wrong in batch dim.