Solved by KFrank in post #5 
              
              
                Hi Mrityunjay! 

Yes, you are correct.  When you call optimizer_ft.step(), the 
optimizer will only update the weights that were specified in that 
optimizer. 
Even, if other weights – not in the optimizer – have had their 
gradients computed, those other weights will not be updated. 

Yes.  Just to…