LeNet architecture is like this:
CONV1->RELU1->POOL1-> CONV2->RELU2->POOL2)-> FC1->RELU->…
Suppose, in forward pass, I want to modify the output of RELU1 and then rewrite the modified version before going to POOL1 layer so that it would reflect on backward pass.
In pytorch, how can I achieve this?