Thanks so much @dashesy. For your  condition
if "conv1a" in name and name.endswith(".bias"):

How about if I change it to all layer has name as convolution. For example, densenet. I want to add the learning strategy for all nn.Conv2d. How should I modify your condition?