When you save a model from Dataparallel it adds an additional module which is reflected on the keywords such that 1st word is always module.
        new_state_dict = OrderedDict()

        for k, v in state_dict.items():
            if k[:7] == 'module.':
                name = k[7:]  # remove `module.`
            else:
                name = k
            new_state_dict[name] = v