A system is provided for interpretable viewing interest. A transformer with multi-head self-attention derives different hierarchical orders of input features. Hierarchical attention layers (i) aggregate the different hierarchical orders to obtain aggregated single-order feature representations and (iii) derive aggregation attention weights for the different hierarchical orders based on an applied order of the hierarchical attention layers. An attentional scoring layer evaluates the aggregated representations to output a significance of each order with respect to various CTR predictions. A hierarchical interpretation layer determines a respective importance of each input feature in various combinations from which the various CTR predictions are derived based on the aggregation attention weights and the significance of each order. A display device displays each of the various combinations for the various CTR predictions along with the respective importance of each of the constituent one of the input features in the various input feature combinations.
INTERPRETABLE CLICK-THROUGH RATE PREDICTION THROUGH HIERARCHICAL ATTENTION