no, I mean I want different hyper parameters for different layer.
say,
layer 1: lr=0.01
layer2 : lr=0.01, weight_decay = 0.01
I have no idea how to specify this since self.parameters() pass all in once.