Hi all,
I know that after a backward pass we can access the gradients w.r.t the parameters (i.e., weights, bias, etc.) of a layer, but is there a way to retrieve the gradients w.r.t the activation coming in and out of the current layer?
Screen Shot 2020-11-13 at 2.18.27 PM1098×412 18.9 KB
Namely, dA_i-1 and dA_i in this graph.