Sorry to make you confused. I just want to set the grad manually, for example, set it to zero tensor. So in every backpropogation, it stays without change, rather than changing based on autograd. Also, I don’t want the update of former layers to be changed.