In your second statement :" All new operations in the torch.set_grad_enabled(False) block won’t require gradients. However, the model parameters will still require gradients".
For example, my pretrained model is an “Encoder” and all parameters of it have been set to “False” in my init function of my “Feed Forward Classifier”. In my train loop,  “with torch.set_grad_enabled(phase == ‘train’):…” is used and phase==“train” is True.
Will my classifier model update my freeze parameter of my Encoder?