What is the behavior of passing all or some model parameters with requires_grad == False to an optimizer ?
If I have a model and want to fine tune it. Some layers are frozen (requires_grad == False and .eval()) with pre-trained values. Should I remove the parameters with requires_grad == False to pass to the optimizer ?