per-parameter optimizer options like this:
optim.SGD([
{‘params’: model.base.parameters()},
{‘params’: model.classifier.parameters(), ‘lr’: 1e-3}
], lr=1e-2, momentum=0.9)
but i don’t know which attribute of model include the PReLU,
optim.SGD([
{‘params’: model.conv.parameters()},
{‘params’: model.bias.parameters()},
{‘params’: model.prelu.parameters(), weight_decay=0}
], weight_decay=0.0001,lr=1e-2, momentum=0.9)
it’s right ?