Hello,
I have seen that is possible to set diferent learnign rates for diferent layers using Per-parameter options. But in my case, I have a lot of diferent modules, and I only want to set a diferent learnign rate for just a layer.
If tried something like this:
self._optimizer = optim.SGD([{'params': model.parameters()},{'params': model.fc2.parameters(), 'lr': 5e-3}], lr=1e-2)
        

But then I ger the following error: ValueError: some parameters appear in more than one parameter group
So, how could I create a list with the parameters I want from a specific layer and then the other parameters left without having duplicate parameters?
Thanks.