Hi,
This might be funny but you have typo in your code.



 chalapathinagavarma:

parms for parmas in model.parameters() if (parms.requires_grad == True)


parms is from loop of original model that you turned its grad off. parmas is the variable you defined in loop within optim.Adam method to get params with required grads.
Bests