Generating Likely Counterfactuals Using Sum-Product Networks
Jiří Němeček Tomáš Pevný Jakub Marecek
The need to explain decisions made by AI systems is driven by both recent regulation and user demand. The decisions are often explainable only post hoc. In counterfactual explanations, one may ask what constitutes the best counterfactual explanation. Clearly, multiple criteria must be taken into account, although "distance from the sample" is a key criterion. Recent methods that consider the plausibility of a counterfactual seem to sacrifice this original objective. Here, we present a system that provides high-likelihood explanations that are, at the same time, close and sparse. We show that the search for the most likely explanations satisfying many common desiderata for counterfactual explanations can be modeled using Mixed-Integer Optimization (MIO). We use a Sum-Product Network (SPN) to estimate the likelihood of a counterfactual. To achieve that, we propose an MIO formulation of an SPN, which can be of independent interest. The source code with examples is available at https://github.com/Epanemu/LiCE.
counterfactual explanations, mixed-integer optimization, sum-product networks
We propose a method for finding Counterfactual Explanations with high-likelihood using Mixed-Integer Optimization (MIO). For the likelihood estimation, we propose an MIO formulation of Sum-Product Networks.