There is described a neural network system for determining a similarity measure between a query data item and a set of support data items. The neural network system is implemented by one or more computers and one or more storage devices storing instructions that when executed by the one or more computers cause the one or more computers to perform operations comprising receiving the query data item and obtaining a support set of one or more support data items comprising a support key embedding and a support value embedding for each respective support data item in the support set. The operations further comprise generating a query key embedding for the query data item using a key embedding neural network subsystem configured to process a data item to generate a key embedding. The operations also comprise generating an attention map based upon a similarity between the query key embedding and the support key embedding for each respective support data item. The operations additionally comprise generating a query value embedding for the query data item using a value embedding neural network subsystem configured to process a data item to generate a value embedding; and determining a similarity measure between the query data item and the support set based upon the attention map, the support value embedding for each respective support data item, and the query value embedding.
CROSS-TRANSFORMER NEURAL NETWORK SYSTEM FOR FEW-SHOT SIMILARITY DETERMINATION AND CLASSIFICATION