Yes, as you can see in the example of the docs you’ve linked, model.base.parameters() will use the default learning rate, while the learning rate is explicitly specified for model.classifier.parameters().
In your use case, you could filter out the specific layer and use the same approach.