About fine tuning, is requires_grad=False on the parameters the expected method to freeze them?
I’ve been using that with a VGG feature extractor for a perceptual loss, but I was wondering if only passing the required parameters to the optimiser is the best way? or both?!