Solved by tom in post #2 
              
              
                Pass strict=False to load_state_dict. 
Then you can iterate for n, p in model.named_parameters() and do whatever you want for n not in sd or so. 
Best regards 
Thomas