Solved by ptrblck in post #2 
              
              
                The manipulation of the .data attribute is not recommended as it might yield unwanted side effects. 
Could you try to “interpolate” the models by using their state_dicts and load the new one into a model instead?