Deep Learning, Artificial Intelligence, Medical Imaging, Image Segmentation, Transformers.
query (Q), key (K) and value (V) matrices: where Unfold() unfolds a D×H×W×C tensor into a (D×H×W)×C matrix. Right part of figure: In the second step, the attention mechanism is applied on Q, K and V. The output of the query vector is a weighted sum of all value vectors, where the weights are