Machine Learning, Neural Networks, Artificial Intelligence, Google Brain, Math.
experiment we can already know that it is possible for the gradients to show weird behaviors due to saturation with in the network. To capture how wide spread the saturation is with in the network the authors have proposed counterfactual inputs. And those inputs can be obtain by multiplying an