Solved by eqy in post #2 
              
              
                I don’t think load_state_dict returns a reference to the model so you likely want to just change 
local_model1 = local_model1.load_state_dict(local_weights[0]) to local_model1.load_state_dict(local_weights[0]).