Ultimately we need only the gradients of weights and inputs of a conv layer. So the gradient computation is slightly changed to do it directly with relu outputs.conv1879×793 150 KB . Above image shows it for filter gradients, we can do similar steps for input gradients