Solved by albanD in post #2 
              
              
                Hi, 
During the forward pass. You have access to x directly if you need the value after each activation. 
If you want the gradient at this point, you can get it by doing x.register_hook(your_hook_fn). Where your_hook_fn will be called with one argument: the gradient of x.