You can use different learning rate and other hyperparameters as well.
Take a look on official example
optim.SGD([
                {'params': model.base.parameters()},
                {'params': model.classifier.parameters(), 'lr': 1e-3}
            ], lr=1e-2, momentum=0.9)

Reference 163 to official docs.