Solved by jpeg729 in post #2 
              
              
                Something like this should do 
# per layer and per weight param
other_model.layer.weight.data = k * model.layer.weight.data + (1-k) * other_model.layer.weight.data