Was the original model saved with DataParallel activated? If so, that explains the module prefix occuring in your state_dict. See my previous answer here 13 for details on how to fix this (in both saving and loading situations).