You could manually remove the module string in each key using one of these approaches 137.
The better approach would be to store the state_dict of the plain model (not the nn.DataParallel model) via torch.save(model.module.state_dict(), PATH), which would avoid adding the module names.