I’m trying to fine-tune a model with several layers. All the examples I’ve seen about fine-tuning is about the last layer or the last few layers, and it’s done by setting requires_grad=False on other layers.
If instead, I want to fine-tune a middle layer, can I just do the same by setting requires_grad=False for other layers? I’m wondering because in my understanding, requires_grad=True on an earlier layer will also cause requires_grad=True for later layers. I’m not sure if this is correct.