Hi mMagmer, thank you for your reply. Not really my case.
What I want to set different learning rate on weights in the same layer. For example, in your example
{‘params’: L.weight }, will update all the weights of L at the same lr. Is it possible to let different weights have different lr? Thank you.