Examples of a prediction explanation system are be provided. The system may obtain a first data record comprising multiple case instances and a first data record neural network providing multiple predictions, each prediction being associated with a case instance. Each case instance may be analyzed to determine a corresponding hidden neuron contribution score, which may be used for clustering the cases instances into multiple instance clusters. For each instance cluster, a decision tree model may be generated, where a decision tree model comprises an explanation for a prediction associated with the case instance in the instance cluster. For a second data record obtained by the system, a second data index comprising a cluster mapping score assigned to each decision tree model may be determined. Based on the decision trees model with a highest cluster mapping score, a second data prediction output providing an explanation for a prediction may be generated.
PREDICTION INTERPRETATION