pay attention to nn.DataParallel. u can print parameters name in the model，to see what is difference between model with and without nn.DataParallel，especially for pytorch version lower than 1. u can try load the model，then use nn.DataParallel  to wrap the model