Solved by ptrblck in post #4 
              
              
                The values in the model parameters won’t be changed, if you assign a new tensor to the key in the state_dict. 
You could either load the manipulated state_dict afterwards or change the parameter’s value inplace as shown here: 
model = nn.Linear(1, 1)
print(model.weight)
> Parameter containing:
tenso…