Solved by albanD in post #2 
              
              
                You need to do the same thing you do to set it to false: 
for param in model.Linear.parameters():
    param.requires_grad = True