Changing learning rate for BertModelforTokenClassification
Dear all,

I wanted to set a different learning rate for the linear layer and the Bert model for a BertModelforTokenClassification. How can I do so? This change should be done after loading a locally saved BertModelforTokenClassification model.

Thank You.
You can specify the learning rate in the optimizer, see the example using SGD below (ref: https://discuss.pytorch.org/t/different-learning-rate-for-a-specific-layer/33670)

```
optim.SGD([
                {'params': model.base.parameters()},
                {'params': model.classifier.parameters(), 'lr': 1e-3}
            ], lr=1e-2)
```<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
