I think I did not address the problem clearly. What I wanted to do is similar to guided backpropagation, which means I want to do a backward pass on a trained model. During the backward pass, I would like to block some skip paths. Then, I do not know how to block the residual.